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INTRODUCtlON 

The launching of the Applications Technology Satellite Number Six 

in May, 1974, signified the beginning of the use of communications satellites 

^for educational television purposes. One of the three educational users of 

rS-6 was the Appalachian Education Satellite Project (AESP) which, by means 

of ^satellite transmission, has offered four graduate-level teacher training 

cour^s--two in career education and two in elementary reading--to 1200 

\ * 
teacheW in eight Appalachian states. An illustration of the ATS Satelfites 



and eartri stations is provided on the following page. 



/ 



In iJuly, 1974, AESP inaugurated ATS-6 communication with the first 
ETV graduate\-level program and later with the first li ve,^/t7rte^j^ve 
seminar by satellite; however, work on the project beganjmuch earlier. In 
1971, a survey \onductetl by the Appalachian RegionaT^^pimiission (ArC) 
revealed that Appalachian teachers wanted more in-service training in 
the fields of readiVig and career education. When the Commission learned 
that ATS-6 transmission time would be available for educational uses, a 
program was planned toXutilize the capability of such a satellite to 

deliver training programs to people in an area which includes many relatively 

♦ \ 

isolated, inaccessible communities. 

As part of this program, ARC chose five main Regional Education 
Service Agencies (RESAs) witPkin the satellite's transmission area to 
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5derdinate and implement the project on the local level: Two ancillary 
^sites for receiving satellite -transmissions were affiliated with each main 
site, for a total of fifteen i:^^ceiving sites where tieachers could meet for 
"classes", via satellite. \ • - 

, In addition .to choosing RESAs, ^he Commission'selected a Resource 
CoordinatinliCenter^ (RCC) to develop-, produce and evalujite all software 
and progranming for the four courses offered. .The ARC deTtd^ to choose 
a university as the RCC for a number of reasons; most important, though, 
was the fact that many universities would already have -most of the necessary 
people and physical reg^^es needed to dfevelop software partiqjjlar.ly 
appropriate to themSjgg institutions^responded 
to*ARC*s request fo^m^m^^^. The University of Ken^uck^in Lexington 
was chosen as. tKeRgs jlurce Coordin^iting Center forxthe'^AESP. 

The RCC \<as organized ijitd six components: reading, career education 
instructional teJevision, four-channel audio, information systems, and 
evaluation. The reading component Was responsible^' for the development of 
two courses in diagnostic and prescriptive reading instruction. The first 
of these two courses was broadcast in the summer of 1974 to an audience of 
approximately 300 kindergarden through third grade teachers. Each of^the 
twelve sessions of the course incorporated such learniog activities as half- 
ho.ur, videotaped instructional programs; fifteen-minute, four-channel audio 
instruction; ancillary instructional materials; and evaluation activities. 
In addition, three times during the course students part:ictpated in a live, 
interactive seminaj^ in which they had An opportunity to query course ^ 
designers and experts in the area of diagnostic and^prescrfpti ve reading 
thstruction* 
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The^career education component had similar responsibi.l ities for a 
course in career education in the elementary grades for the summer of 1974. 
The format was similar to the reading course, offering twelve half-hour 
videotaped programs, supplementary materials, and four live, interactive 
seminars. 

The fall of 1974 marked the introduction of. a career education 
course for secondary school teachers and administrators composed of 16 
hour-long live, interactive seminars. This course format enabled students 
to interact with notables in the field of career education and communicate 
questions to seminar participants through radio and teletype hook-ups (via 
satellite) with the studio. 

In the spring of 1975 second course in diagnostic and prescriptive 
reading instruction was offered. The audience for this pourse was approx- 
imately 300 kindergarden through sixth-grade teachers. Using the first 
OPRI course as a building block, this course incorporated seven new video- 
taped television programs into the series. A picture of course participants 
watching one of the programs is presented on the following page. Ancillary 
materials, Vive, interactive seminars, and four-channel afudio segments 
were revised to reflect audience changes. Ijp both of these colirses the 
reading component was responsible for script and ancillary materials 
development. / The Component Director also insured that these courses met 
academic standards for the University of Kentucky and other cooperating 
universities which granted three semester hours of graduate-level credit 
for each course. It is the purpose of this report to examine this course 
in detail, by focusing on the course production, technical aspects, and 
the participants' reactions to and learning increments gained in the course. 
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Course Overview 

The spring 1975 Diagnostic and Prescriptive Reading Instruction 
(DPRI) course was designed to offer teachers individual experience in 
diagnosing children's specific reading problems and locating materials to 
remedy those problems.^ The course featured classroom teachers and students 
who illustrated new and innovative reading techniques. The course was 
practical, classroom-oriented, and provided teabh^rs with the following: 

- diagnostic procedures ^ 

- procedures for combining diagnostic with prefcHftivV instruction 

- prescriptive instructional techniques 

Course Struc^re ^"^ 

Students were able to choose from three opttjoni for course credit: 
«* 

1 . A K-3 program 

2. A 4-6 program 

3. A K-6 program 

^ In completing any one of the three options, the stud^gnts completed 
13 units of study. This involved selecting 13 TV programs from the total 
series of 1 7, "^d completing the associated laboratojr^ and four-channel 
activities. Upon co^iipTetlor\ of the chosen enrollment program, each 
participant was granted three semester hours of graduate credit. 
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Course Content and Objectives 
The topics and objectives fo^the seventeen programs* were: 

PROGRAM 1: DPRI INTRODUCTION - 4-6, K-6 ^ \^ 

1. identify reading sub-skills 

2. identify the parts of the diagnostic-prescriptive reading 
instruction model 

3. realize the importance of early diagnosis and correction 
of reading problems ^ 



PROGRAM 2: INFORMAL TESTS / K-3, 4-6, K-6 

1. recognize/ the advantage of informal reading tests ^ 

2. interpret the results, of informal reading tests 



3. identify the sequence of ^activities involved in constructing 
an informal \reading inventory 




The Potter and Ffeeyoook, Informal Reading Diagnosis , from the 
reference sherOi!^?^ ^^ed. 



PROGRAM 3: STANDARDIZED TESTS -- K-3, 4-6, K-6 

1. identify the procedures necessary for effective 
administration of standardized tests 

2. interpre;tAhe.j:4^ults of standardized tests % 

3. recognize the strengths and limitations of stlindardized 
tests 

The Stanford Achievement Test, Prijnary I and II and the 
Murphy-Durrel 1 Reading Readiness Analysis was used. 



*A1 though programs from the previous DPRI course (DPRI K-^, Summer, 197 
were used in this course, (DPRI K-6, Spring, 1975) -they were not used 
in the same numerical sequence. Therefore, requests for information on 
the tape^i^no^^ams for either DPRI course should specify wnich course is 
being referred^ttr^-^ 

. ■ ■ „ \r 



PROGRAM 4: WORD RECOGNITION TEST ~ K-3, K-6 option with Program 5 

1. axl«q^is|:er and interpret the re^sults of the Wisconsin 
uesiqn for Reading Skill Development: Word Attack 

2. connect diagnosis to the instructional materials^ 

3. identify the sequence of activities involved in going 
through a complete test-teach-test instructional cycle 
using the WDRSD:WA 

The Wisconsin Design for Reading Skill Development: Word 
Attack was used. 



PROGRAM 5: COMPREHENSION AND STUDY SKILLS TESTS - 4-6, K-6 option 
with Program 4 

1. administer and interpret the results of the^ Fountain 
Valley Teacher Support System in Reading 



2. 
3. 



connect diagnosis to instructional procedures 



identify the sequency of activities involved in going 
through a complete test-teach-test cycle 

4. determine the steps a total school needs to go through 
in implementing DPRI 

The Fountain Valley Teacher Support System in Reading was 
used. 



PROGRAM^: MISCUE ANALYSIS — K-3, 4-6, K-6 

\ \ 

1. \identify and do the sequence of activities^ involved in 
^ a^inistering the reading miscue inventory 

2. cate^rize reading miscues 

3. compileVthe results of the reading miscue inventory on 
coding sfteet 

4. identify Wayne's reading strengths and weaknesses 
The Jt^ding Miscue Inventory was used. 
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PROGRAM 7:^^^PRESC^TIVE INSTRUCTIONAL SYSTEMS - K-3, 4-6, K-6 

1. translate test results into words (descriptors) that can 
be used to find materials in the retrieval systems 

2. identify the sequence of steps in the process of materials 
selection 

3. determine which skill descriptors are most appropriate 
for each student 

4. recognize the strengths and limitations of different 
retrieval systems 

Selected Retrieval Systems was used. 

PROGRAM 8: DPRI MANAGEMENT - 4-6, K-6 

1. identify Several patterns of grouping 

2. assess the |({rengt and limitations of grouping patterns' 

3. determine the most ap))ropriate grouping pattern in a 
given situation 

4. recognize reasons for using a grouping pattern in a - ^ 
given situation 



-^PROGRAM 9: READING READINESS AND BEGINNING READING - K-3, K-6 
option with Program 10 

1^^ identify activities used to teach reading readiness 
/ and beginning reading 

2. list advantages and disadvantages of the activities 

3. determine which activity is most appropriate for a given 
situation 

The Teaching of Reading served as a resource for Programs 9-1 7 < 



PROGRAM 10: THE EXCEPTIONAL READER -^4-6, K-6 option with Program 9 

1. identify activities and procedures to teach the low 
average and gifted reader 

2. list advantages and disadvantages^of each of the activities 

/ 

3. determine which activity is most appropriate for a given 
"Xs.' situation 
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PROGRAM 11: WORD RECOGNITION - A-6, K-6 

1* identify activities used to teach word identification 

2. list advantages and disadvantages of the activities 

ietermine which activity is most appropriate for a given 
sSstuation 

PROGRAM 12: VOCABULARY — K-3, K-6 option with Program 13 

1. identify activities used to teach vocabulary 

2. list advantages ^and disadvantages of the activities 

3. determine which activity is most appropriate for a given 
situation 

PROGRAf-l 13: STUDY SKILLS - 4-6, K-6 option with Program 12 

1. Identify activities used to teach study skills 

2. list advantages and disadvantages of tie activities 

3. determine which activity is most appropriate for a given 
situation ^ / 

PROGRAM 14: COMPREHENSION — K-3, K-6 option with Program 15 

1. identify question strategies used to teach comprehension 

2. write questions to stimulate student responses in 
various categories (i.e. knowledge, translation, etc.) 

3. determine the most appropriate question strategy for 
a given situation 



PROGRAM 15: READING IN THE CONTENT FIELDS - 4-6, K-6 option with 
Program 14 

1. identify activities used to teach reading in the content 
' fields 

V 

2. list advantages and disadvantages of the activities 



3. 'determine which activity is most appropriate for a giveq 
situation 
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PROGRAM 16: DEVELOPING LIFE-LONG READERS - K-3, 4-6, 

1. identify activities that assist in trfe^development of 
reading interests and tastes \ 

2. list advantages and disadvantages of the actiVUies 

3. determine which activity is most appropriate for a given 
situation 



PROGRAM 17: TOTAL READING PROGRAM - K-3, 4-6, K-6 

1. identify ways to encourage parental participation in 
reading programs 

2. recognize the strengths and limitations of DPRI 

3. determine ways to implement diagnostic-preicriptive 
reading instruction in a total reading progranj 

4. determine ways to establish priorities fqr^mplementation 
•of DPRI 




In addition all students participatei€jn five, hour-long live, 



interactive seminars. These seminars were designeotosirpvide students 
with the opportunity to interact with course designers and exp^1f<§ in the 
field of reading. A picture of a site coordinator transmi tti;><^s^minar' 
questions to panel experts is presented on the followingf^age. 

Preprogram, laboratory and follow-up activlMes were carefully 
outlined for each program in the ancillary maj^^ials packets supplied to 
each student. An important part of these activities was the assignment 
that each course participant was ask^to identify an elementary school 
student to work with throughout tf^e duration of the course. Working with 
a student gave each participefnt practical experience in working with tests 
and testing procedures^ 




Huntsville, Alabama Stte Transmitting 
Seminar Questions Via VHF Satellvfee Delivery System 



/ 
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In addition to the ancillary materials packet, each course 

participant was provided with the following materials free of charge: 

Dallman, Martha, and others. Th e^ Teach i n g Of-Read i ng . New York: Holt, 
Rinehart, and Winston, Inc., 1974. 

Goodman, Yetta, and Carolyn Burke. Reading Miscueyrhventory Manual . 
New York: The MacMillan Company, 1971 . ~7 

Homme, Lloyd. How to Use Contingency Contracting in the Classroom . 
Champaign, Illinois: Research Press Xo. , J 970. 



Madden, Richa^rd, and others. Stanford Reading Test, Primary I> II> and 
Intermediate I . New Yorkl Harcourt, Brace, and Jovanovich, Inc. , 
1972. Specimen S^ts. 

Murphy, Helen, and Donald Durrell. ^ Murphy-Durrell Reading Readiness 
Analysis . N^w York: Harcourt, Brace, and JovapaVicn, inc., 
1964. Specimen Set. 

Otto, Wayne and Eunice Askow. The Wisconsin Design for Reading Skill. 
Development: Word AttacF ! Minneapolis, Minnesota: National 
Computer Systems, Inc., 1972. • 

Zweig, Richard L.V Fountain Valley Teacher Support System in Reading . 
Richard L. "Zweig Association, Inc., 1972. 

Supporting Components 

The television component, a part of the Media Services Division of 
the University of Kentucky, played a major role in course developmerTt* 
Its facilities and^ personnel were used in producing and delivering 17 
half-hour videotaped programs; five live, interactive seminars; and 
seven fifteen-minute four-channel audio reviews for this course. 

This component was also very much involved in the formative stages 

of course development. Since field filming of exemplary class/^oms was 

incorporated into the programming, the producer-director and content 

♦ 

experts worked closely in planning and developing each televised program. 
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The exemplary classrooms weife chosen from those identified by the five 
main RESAs, and were thus rjepresentative of the different regions the 
course served. 

I 

Tvyo other supporting components incorporated in this course tested 
the, communication capabilities of the satellite and helped to insure the 
success of the course, ^ne ms the four-channel audio instructional system 
which was used to reinfdrce learning in the video programs. To complete 
the audio review, each participant was, equipped with a head phone set 
and an answer selection pad with fdur response buttons. After receiving 
programmed audio instruction in the form of a hypothetical description 
of a teaching situation and four alternative approaches to the problem 
posed, the teacher selected-response by pushing a button. ,The teacher 
then heard pre-recorded fe^back which reinforced the selection of the 

correct answer or corrected any misunderstanding if an inappropriate 

/ 

response had been made. 

The other supporting component unique to 'the Appalachian Education 
Satellite Project and used in this course was the computer-based information 
retrieval system. This consisted of a combination of computer-based and 
manual information systems for storing, retrieving and delivering to teachers 
in their communities information and references for instructional materials. 
Course participants asked for information by specifying grade level, subject 
area, objectives, and the nature an'd diversity of the students in the class 
they were teaching. Requests were relayed via satellite to the RCC wh^e 
they were processed. The teachers then received listS-.of activiti^'and 
resources for 'both themselves and their pupils. 



24 



15 

Formative and summative evaluation procedures were developed and 
implemented by the evaluation component. The formative evaluation process 
assisted with the development of the course. The evaluation component was 
also responsible for the summative evaluation of the course, including 
pre- and posttest measures of cognitive and affective achievement, the 
degree of classroom implementation of the teaching strategies and procedures 
presented in the course, and participant ratings of the learning activities 
produced for the course. 

In examining thi^ course, the focus will be on answers to the 
following question^: 

- How much did the course participant learn? 

- How effective were the learning activities included in 
the course? How might they be improved? 

- How reliable was the equipment used in conducting the 
course? 

• How valuable were the information systems that were 
available to course participants? 

- What was the overall rating of the course? 



er|c 




25 




METHOD 



Subjects 



i 



About twenty participants were enrolled at each of the fiteen sites 
for the DPRI K-6 course. The number varied because some sites requested 
that additional students be allowed to enroll due to the demand for reading 
instruction for classroom teachers in the area; where the facilities could 
accoirmodate more students, they were enrol led, Jn total s\S participants 



took the pretest and 286 completed all^course requirements./ Complete data 
(all cognitive and affective pre- and pd^ttest) for analysis were available 
for 282 participants. The number .of ^rt^ci pants at each si.te by course 



option is presented in Table 1. 



A combined attitude and background questionnaire was administered to>.. . ■ 



the CQurSe participants prior to the first televised lecture. This 
questionnaire which is presented in Appendix 1 ^^as divided into two parts. 
The first part was concerned with the participants' ^ttltudes toward 
reading, and the second part asked for some background information concerning 
educational practices and teaching experience. Table 2 surranarizes the back- 
ground information obtained. 
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TABLE T 



E^MS 



DISTRIBUTION OF PARTICIPANTS BY OPTIONS BASED ON FINAL EM 
(Complete Data Cases Only) 





^ Option 


V 




Site ■ / 


K-3 
(1) 


4-6 


. .(3) 


Total 

1 


11 Fredonia, N.Y. 

12 Olean, N.Y. 

13 Edinbol^o, PA 


4 
9 
4 




13 ■• 

7 


'20 
21 
14 


21 Lafollette.VN 

22 Coalfield, m 

23 Johnson City, TN ' 


6 

8 


6 ' 

5 

0 


15 - 
4 
10 


27 

17 
. -19 


31 Norton. 'VA 

,32 Sticklyville, VA 

33 Boone, N.C. 


6 

,6 
0 


3 
0 
0 


2 
9 

18 yrj^ 


11 

15 
18 


41 Cumberland, MD 

42 Keyser, W.V. 

43 McHenry, MD 


3 

12 
3 


0 
3 

5 


08 
4 
11 


21 
19 
19 


51 Huntsville, AL 

52 Guntersville, AL 

53 Rainsville, AL * 

TOTAL 


4 
3 

8 . 
85 


3 

\ 5 
40 


2b 

16 

' 2 
157 


11 
19 
15 

282 
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TABLE 2 

SUMMARY BACKGROUND INFORMATION FOR SPRING READING COURSE PARTICIPANTS 

(N=308) 



Item 



Type of community 
where participant 
worked 



Sex 



Age 



Position during 
1974-75 academic 
year 



Responses 



Graded level taught 



ERIC 



Rural - . • 

Suburban 

Urban 

No Response ' 

Male 

Femal e 

No Response 

21-23 
24 -,26 _ 
27 30 
31-40 
41 - 50 
51 - 60 
61 and over 
No Response , 

Classroom Teacher 
Reading Specialist 
Special Education Teacher 
Counselor 
Principal 

School Administration 
Other ^ 
No Response 



Elementary - all grades 

K 

1 

2 

3 

4 

5 

6 

7-12 

No Response 



Frequency 



28 




Percentage 



66.0^ 
15.CU . 
18.0 
1.0 

19.0 
80.5 
0.5 

19.0 
22.0 
15.0 
21.5 
16.0 

6.0 

0.0 

0.5 

63.0 

8.0 

9.0 

1.0 

1.0 

3.0 
13.0 

2.0 

25.0' 

9.0 
10.0 • 

8.0 
11.0 
11.0 

6.0 

8.0 
10.0 

2.0 
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TABLE 2-CONTINUED 



Item 


\ Response 

\ 


Frequency 


Percentage 


nU 1 N CApci icIiUC III 


1 jcaf U 1 1 CO b 




9n n 


tcaUfl 1 


CO yea lb 


A9 


9n n 




H-j yea lb 


ou 


1 n 




D-0 yeaib 


OD 


n n 




-7 1 V yea lb 


1 ^ 


c: n 
D* u 


- 


11-10 years 


AO 
He 






16-20 years 


• 23 


7.0 


• 


21 years or moire 


' 19 ■ 


7.0 


LApcr lence ab reauiny 


M 

iNone 




QQ C 


specia n s t 


1 year or less 


^1 


7 n 
/.O 




years 


0 
O 


o n 




4-5 years 


b 


o n 




0-/ years 


o 
c 


1 n'' 
1 . U 




t o-y years 


0 
0 


1 n 




10 or more years 


1 


0.5 




No Response 


19 


6.0 


H n ^ A Y^n ^ 1 1 3 ^ a ^ D A 

unaGrgraaua Lc urrt 


Lesb unan 


* D 


C • u 


I'f points - M; 




C4 


Q n 






CO 
DO 


oo n 






/D 


OCT n 




3.01-3.25 


46 


15.0 




3.26-3.50* 


40 


13.0 ^ 




o CI ^ nn 
' o.b 1 -4.UU 


0 1 


in n 




No Response 


1 / 


c n 


v%tk • ^ ^ PDA 
brauiiate brM 


Less tnan o.u 




1 n 


(4 points = A) 


3.01 -3.25 


zz 


7 n 
7.0 




3.26-3.50 


23 ' 


7.0 




3.51-3.75 


57 


18.0 




3.76-4.00 ^ 


74. 


24.0 




No Response 


128 


43.0 


1 21 c ^ n^nv^aA ^^mrilQ^oH 

Labt Ucyrcc CUiiipicucCl 


Wink* Q/^l^r\nl Hinl rMna 

niyn ocnoui uipiunia 


7 


9 




Baccalaureate 


220 


21.5 




Masters 


68 


22.0 




Specialist 


4 


1.0 




Doctorate 


1 


0.5 ; 




No Response 


8 


• 2.5 


• 




<• 


« 




T 
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TABLE 2--C0NTINUED 



\ Item 


Response 


Frequency 


Percentage 


— \ 

NumbeKpf undergraduate 


None 


104 


34.0 


residing x^urses 


1 


92 


30.0 




2 


58 


19.0 




3 


14 


4.5 




4 


7 


2.0 




5 or more 


. 10 


3.0 




No Response 


23 


7.5 


Number of graduate 


None ^. 


184 


• 

60.0 


reading courses 


1 


- 42 


14.0 




2 


- 18 


6.0 




3 


7 


2.0 




4 


8 


2.0 




5 or mt)re 


6 


2.0 




No Response 


43 


14.0 


Enrolled in college 


Baccalaureate 


6 


2.0 


degree program 


Masters 


92 


30.0 


* 


Specialist 


11 


3.5 




Doctorate 


2 


0.5 




Enrol ted but not in 








degree program 


48 


16.0 




^ Enrolled in courses tff 








maintain teacher 








certification 


35 


11.0 




Not enrolled 


64 


21.0 


9 


No Response 


50. ' 


16.0 -. 
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• y. , Procedures and Instrumentation 

Tb obtain meaningful suninative evaluation data for the course, the" 
evaluation component relied upon well-defined procedures and a variety of 
instruments. (Copies of all instruments except the cognitive pretest, 
midterm and posttest, appear in Appendix 1.) Table 3 presents the time- 
lihe for the course, the instructional activities scheduled for each class 
session, and the evaluation instruments administered throughout the course. 

Achievement Test? 

Prior to th% fij^sj. class session all students completed a pretest 
which was comp^S^toTeS multiple-choice questions measuring students' 
cognitive knowledge abouT^dia^rr^^ prescriptive reading instruction- 
Following the eighth class meeting studertts^^iere administered a midterm 
test. This examination was composed of two partr^^-^l^e^ir part contained 
3,|5 items based on information contained in the first sdven>kl^ programs • 

*The second part, composed of twenty items, served as a pretest for^our of 
the last ten programs that were. not covered- on the rnittrT pretest* This 
procedure was necessary because of the inability of the Reading Component 
to provide detailed information about these four programs prior to the start 

( of the course, ^ifs, these items were constructed after the course began. 
During the final class meeting a posttest was administered. This test was 
composed of three separate forms, one for each of the class choicesj^^J<-^ 
4-6, and Each version was composed of thirty items which related to 

the last ten programs. Together, these tests were used to measure the 
learning in the area of reading which occurred as an outcome of the course. 
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TABLE 3 



SCHEDULE OF INSTRUCTIONAL ACTIVITIES 

V 



Sessions 



Activities 



January 14 - 




TV 




4-Channel 


Laboratory 


May 20, 1975 


^Evaluation 


Programs 


Seminars 


Reviews 


Sessions 


1 (1/14/75) 


Pretest 
Attitude Test 
Background 












Questionnaire 










2 (1/21/75) 










X 


3 (1/28/75) 




3 




X 


X 


4 (2/4/75) 






1 






5 (2/11/75) 




4 & 5 






X 


6 (2/18/75) 




6 




X 


X 


7 (2/25/75) 


Pre- an^ost- 
test 


7 




X 


X 


8 (3/4/75) 




' 2 






9 (3/11/75) 




V 

8- 




X 




10 (3/18/75) 




' 9 & 10 








11 (3/25/75) 




11 




X 


X 


12 (4/8/75) 






3 






13 (4/15/75) 




12 & 13 






X 


14 (4/22/75) 




14 & 15 






^ X 


15 (4/29/75) 




16 




X 


16 (5/6/75) 






4 






17 (5/13/75) 




17 . 




X 


X 


18 (5/20/75) 


Posttest. 
. Attitude Test 
Information 
Systems Ques- 




5 








tionnaire 
Summative 
Comments Form 


/ 









r 



*In 



addition* to t|ie evaluation instruments listed on the table- 

the Site Coordinator's Checkl 
by the site coordinator; and 



1) the Site Coordinator's Checklist was completed after each class session 
rdrna 



2) the Class Rating Form v/as completed by approximately 1/2 of the partici- 
pant^ after each TV program, seminar, 4-channel activity and laboratory, 
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Attitude Questionnaire 

The attitude portion of the Combined Attitude and Background 
Questionnaire was administered to participants on a pre-post basis. 
The instrument contained 27 Likert scale items, with 1 = complete!^ disagree 
and 8 = completely agree. The purpose of this instrument was to measure 
participants* affective attitudes toward the procedures, techniques, and 
theory of diagnostic and prescriptive reading instruction,^ 

Factor analysis of the instrument revealed a uni factor structure. 
The first factor accounted for 70% of the estimated common variance. 
Loadings for this factor are presented in Table 4, Items having loadings 
less than +.30 or greater than -.30 were deleted for purposes of scoring.^^ 
Responses to the 21 items remaining on the scale were added together to 
provide a single measure of the participants' attitude toward the concepts 
and methods of instruction presented in the course. Item scores were 
reversed for negatively worded items, 

\ Site Coordinator's Checklist 

\^ At the end of eachxlass meeting the site coordinator completed the 

'^ite Coordinator's Checklist. Using this simple checklist, equipment 
tJCOuble and the audio and video strength were reported. This instrument 
also sol icYt^d-tJae^site coordinator's subjective evaluation of the students' 
^^^^"^ satisfc(Ction with the seminar and lab activities. 

Class Rating Form 

After each class session, approximately one-half of the students 
completed a Class Rating Form (CRF). This questionnaire dealt with the 
participants' reactions to the day's instructional activities. The 

/ 
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TABLE 4 

FACTOR LOADJNGS FOR ATTITUDE POSTTEST* 

Factor 

Item # ' Content - Loading 



1. Reading instruction should focus on comprehension. .28** 

2. Students should be exposed to a variety of 

experiences. .49 

3. Analysis of oral reading miscues is worthwhile. .20** 

4. * Integrate reading with all other classroom activities. .33 

5. Contingency contracting is worthwhile. .52 

6. Reading readiness can be developed in students. .45 

7. Information systems linking diagnosis and instruction 

are valuable. .47 

•8. Vocabulary should be taught through real -life 

experiences. .21** 

9. Grouping on skill needs is more valuable than on 

instructional level. .26** 

lb| Studehts should not all^read the same thing. .53 

11. Teachers should not diagnose students only in the 

fall. .49 

12. Emphasis given to phonics changes with student - 

needs. * .22** 

13. Teachel^ sljiould diagnose student reading problems. .26** 

14. Inf(Drmal tests are used for placing students at 

riaht levels. .32 

lis. Pr;escriptive instruction is the best way to teach 

V reading. .45 
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TABLE 4— CONTINUED 



' • . » ">B.>^ ^ Factor 

Content . — Loading 



V 

16. A child should* not necesscuijly read all the way 

through a book. ^ .45 

17* Kindergarten teachers should worry about 

comprehension,^ ' ,58 

18, Work with individuals, even in a large clas^ ,48 

19, Third grade teacher needs, mare than_yiicd-4t:^^ 
materials. . — ^ ,82 

20, Understanding graphs and tables is an aspect of 

reading instri^etion. .64 

21, A good reader need not necessarily read every word 
correctly. .57 

22, Every page in a workbook need not be used. ,65 

_23, Scores on standardized tests aren't adequate for 

instruction, ,52 




There are things a teacher can do to generate 

enthusiasm, ,62 

Time spefit diagnosing is well spent. .61 

26, Effective materials don't necTessarily include 

one copy per student, .55 

27, Free reading caabe productive, ,85 



Free leading can^^be productive. 



*I terns are paraphrased. NegaViv6 items are reworded to appear in the 
positive direction. Signs for loadings are consistent with these 



rewordings. 
**Item deleted for scoring purpose^. 
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questionnaire sought. reactions to the TV programs, four-channel audio 
activities, the live, interactive seminars, and the laboriitory activities. 
On a given day, the selected participants filled out only the parts of 
the form that corresponded to that day's activities. For purposes of 

r 

completing this instrument the class participants were randomly divided 
into two groups and the responsibility for completing the-^rtistrument 
alternated between the two groups. Thus on a given class day roughly half 
^^the ^participants completed the appropriate sections of the CRF. 

Informat^^on Systems Questjonnaire 

During the last class^^slon participants completed the Information 
Systems Questionnaire (ISQ). Thir**hiis^(A^ had two parts. Part I was 
concerned with the participants attitudes toward the iaformation systems 
presented in class. The fourteen items in Part I were Likert items to 
which participants responded on a scale where one equaled strongly agree 
with the statement and five equaled strongly disagree with the statement. 
Means and'stai^ard deviations were calculated for each item in this section 

Part II of the instrument was concerned with the degree to which 
participants used information systems to assist them in^developing course 
mat^erials for the classes they teach. These-ttem^s-were^oTthe yes/no 
variety and frequency counts of the responses were tabulated. 

Summative Comments Form * 

The Summative Comments form was administered to measure student 
and site coordinator perceptions of the overall effectiveness of the 
course. On the first part answers were solicited to detemjine what site 
coordinators and participants specifically liked or disliked about the 
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course. The second part asked them to rate ten instructional activities 
according to the quantity of useful information they received from each. 
The standard of reference was the average, graduate level course. An 
eight-point Likert scale (1 = outstanding to 8 = unacceptable) j/as used for 
the rating. Mean scores were calculated .for each of>th^e"item^ 
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RESULTS 



In the introductory section it was stated that this report would 
attempt to answer five research questions. The results, which follow, are 
organized around and presented for each of these questions. 

- How much did the course participants learn? 

As may be seen in Table 5, several versions of the^aclueveme nt tes t s " 
were required to measure achievement over^Jiie levera^ paths 
available in the course. In ordec^^-t6^ better analyze gains made in 
cognitive achievement, itjwirs decided to use as the premeasure the 
percentage right out of all 83 pretest items; and as the postmeasure the 
percentage rigfvt out of the 35 midterm items plus the 33 final exam items 
selected by the student. An analysis of variance done "^n the pre- to post- 
gain, by course option, indicated no significant differences in achievement 
associated with the different course options. Thus, the option selected 
was not ^^variable that needed to be considered in the evaluation of 
pre- to postgains. ^ 

The analysfr"of variai:ice design used for the gain analysis was as 
follows. Itjvas decided to ar^alyze^^ain on the attitude scale along with 
tfie^ichievement test gain. Thus, a multivariate aTialysis of variance 
(MANOVA) was appropriate. Procedures described by Finn (1968, 1969) for 



repeated measures designs were followed. The MANOVA included three factors 

/ 
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with repeated measures On the third factor. The first factor was RESA 
triangle (T). This factor had five levels and was considered to have } 
fixed effects. The second factor was sites: since each^slte was .associated 
with a RESA trian^e, the sites were considered to be nested within 
triangles ($:T). This factor J;iad three levels and was considered to have 
random effects. The third factor was pre- vs. postcourse administration 
this factor had two levels. 
The MANOVA revealed significant differences between and within tri- 
angles due to administrations (Table 6). To determine which of the dependent 
variables were affected, univarate and step-down F's were computed, these 
statistics Indicated significant effects on the achievement variable for 
both A and A X S:T sources of variance (Table 7). Results of the MANOVA 
Analysis for the precourse scones (Table 8) ^ndicate that there were 

differences between sites on the achievement variable (Table 9). The 

*/ — 

MANOVA run on the postcourse scores (Table 10) revealed no significant 
differences attributable to triangles or sites. 

The mean proportion right for the overall (combined) pre-achievement 
measure was .489 (sd = .101) and for the overall postmeasure was .714 
(sd = .098). This post meari is fairly high, and it may be concluded that 
^jnas^t^ry of the material was achieved by the participants. Since many of the 
terns had been used before, it was possible to screen out items that were 
too easy; thus, a mean of over 70% is quite good. The core o;f these 
achi^yement items was the set of criterion-referenced items written for 
the DPRI K-3 course offered during the summer, 1974. Jhese items .were" 
selected and revised based on i^em reliability, difficulty, .and discrimi- 



\ I TABLE 6 



MULTIVARIATE mUStS OF VARIANCE RESULTS 



Source 



Multl' F 




Between Subjects 
fri angles (T) 



Sites within Triangles (S:T) 
WithinSubjects ^ 
Administrations (A) 
A X f 
A X S:T 



TABLE 7 • 
- UNIVARIATE AOV RESULTS FOR^^IGNIFICANT MULTIVARIATE CONTRASTS 



Contrast 


Variable 
J 


Univ. F 


P< 


Step'-%)wn F 


•p< 


A . 


Achievement 


21.39 


, .0001 


21.39 


.0001 




Attitude 


.001 


.97 


.02 


.89 


A X S:t 


Achievement 


4.08 


.0001 


4.08 


..0001 












Attitude 


.79 


.64 


.79 


.64 
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TABLE 8 

mNOVA RESULTS FOR PRECOURSE MEASURES ONLY 



Source 



df 



Mult. F 



P< 



Between Subjects 
T 

t 

S:T 



8,18 
20,532 



.9222 
1.9546 



.5213 

.0081 
— — 



TABLE 9 

UNIVARIATE AOV OF PRECOURSE MEASURES FOR SIGNIFICANT MANOVA CONTRASTS 



Contrast ^ 


Variable 


Univ. F 


P< 


Step-Down F 


P< 


^ S:T 


AchieveiriCnt" 
Attitude 


.^^1.6676 


.0094 


2.4072 
1.5177 , , 


.0094 
,1328 



^A^kr-'io 

MANOVA RESULTS POSTCOURS^^URES ONLY 



Source 



df 



Mult. F 



p< 



Between Subjects 

T .8,18 
>fT 20,532 



1.3216 
1.4124 



.2946 
,1098 



42 
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nation indexes. By eliminating the easy and undiscriminating items, the 
nature of the achievement test changed. It became an instrument that 
discriminated among individuals based on content knowledge^ rather than a 
criterion-referenced instrument that covered all content, trivial or not. 
Basically, the test became harder, even though 20 new items were added for 
the new programsv^ 

The reason no gains were recorded for the attitude scale may be 
that the participants* attitudes upon entry to the course were very positive 
and) it was difficult for the attitude socres to be substantially improved 
as a function of the course. The pre- and postcourse means for the 
attitude scale items are*presented in Table IK (These means are not 
reversed; for obtaining the total score, responses to negative items were 
reversed). The precourse mean for the attitude scale was 147.288 

(sd = 15.402) and the postcourse mean was 153.835 (sd = 15.531). 'These 

^» * 
translate into mean item scores on the eight-point Likert sQale of 7.XTt4-— 

(pre) and 7.325 (post) and a per item mean gain in attitude of .311. 

- hovi effective were the learning a^ctivi ties included in 
the course? How might .they be improved 
. Information relative to the perceWed effectiveness of each learning 
activity was obtained from the Class Rating Form and the Site Coordinator's 
Che.cklist. The learning activities rated were the televised programs, four- 
channel alKl4o reviews, seminars, and laboratory sessions. The Class Rating 
Form provided separate, ratings for each activity orf each class day. These 
ratings are summarized across*. occasions for each of the learning activities, 
that Is, the frequencies of responses to each alternative of each Item are 



ERLC / 



34 



TABLE n 
ITEM MEANS FROM AHITUDE SCALE 



Item 


Pre-Mean 


SD ' 

* 


^ 

Post-Mean 


SD 


1 


6.10 


2.00 


\ 

\ 

\ 

7.13 


if 

1.31 


o 
C 


/.38 


1 .30 


7.67 


.89 


0 
0 


L. 64 


1 .80 


4,25" - 


2 . 39 




7 A A 


1 .42 


7.63 


^4^0 


c 


0 "7C 

c.lo 


1 .85 


1 .89 


1 .45 


c 
0 


1 . 56 


1 .54 


1 .56 


1 .53 


7 


\ 7.07 


1 .28 


7.01 


1 .31 


o 
o 


\ 6.61 


1 .46 


-7.04 


1 .20 


9 


6.15 


1 .95 


6.52 


1 .88 


10 


1 .45 


1 .05 


1 .29 


.82 


11 


1 .52 


1 .54 


1 .40 


1 .34 


12 


6.71 


1 .77 


6.89 


1 .55 


13 


' 6.42 


1.91 1 


6.68 




14 


5.99 


1 .96 \ 


6.85 


1 .66^ 


15 


6. 16 


1 .66 


7.08 


1 .33 


16 • 


2.48 


1.81 


2.18 


1.71 


17 


1.65 


1,47 


1.60 


.1.39 
■1.63 


10 


1.95 


1.76 


1.92 ^ 


19. 


1.27 


1.02 


1.15 


.70 


20-. 


r.64 




1.51 


1.21 


21 


, . 1 . 98 
V 1.85 


1 


^ 1.84 


1.44 


22 , 




J. 51 


1.13 


23 


2.62 - 


1.79 "v. 


1.99 


1 .49 


24 


\ 1.66 


1.37 \' 


1.52 


1.20 


25 


<L.18 


1.62 ^ 




1.40 


26 


2.47 - 


2.04 


X 1.96^^^ 


^ 1.58 


.27 


1.51 


1.18. 


X. 1-21 





Note: 8 point Likert scale - 8 = agree 




disagree 
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summed across all TV programs, four-channel audio reviews, seminars or 
laboratory sessions. These results are discussed in subsequent sections of 
the report. (For the mean ratings of individual activities see Appendix 2j 
Table 12 presents the site coordinator ratings of participant satisfaction 
with the instructional activities. The frequencies in this table correspond 
to separate activities except for the ratings of televised programs where 
two programs were presented on a single day. In this case the rating is ' 
given for the two televised programs together. 

There is considerable variation in the ratings of activities across 
occasions, and this information is valuable for program revision or as a • ^ 
guide to the development of new programming of a similar nature. Space 
does not permit a thorough discussion of each separate televised program, 
b^activity, etc. Therefore, the focus of this section will be on the 

0 

overall participation ratings taken from the Class Rating Form (Tables 
13-16) and on the site coordinator rating? reported in Table 16. 



Repre&en^ive student comments will be introduced where appropriate to 
illustrate TO£ general points that are made. 

V' 

^ Televised Programs 

As shown in Table 13 (Part I of the CRF) participant evaluation of 
the programs (item 14) was "good" to "very good". Assigning point values of 
5 for excellent to 1 for poor to the possible responses for the question, 
a median rating of 3.68 was obtained on this item. Responses to the other 
items reflected the same general level of satisfaction with the programs. 
Students expressed little concern for major revisions of the' televised 
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TABLE 12 

FREQUENCY OF SITE COORDINATORS RATINGS OF PARTICIPANT SATISFACTION 
WITH INSTRUCTIONAL ACTIVITIES 



oession 


Program* 


TV Program 


4-Channel 


Laboratory 


High Moderate Low 


High Moderate Low 


High Moderate Low 


2 


TV-1,2 


12 


3 


0 








10 


2 


2 


3 


TV- 3 


13 


2 


0 


8 


6 


0 


10 


5 


0 




Sri 


3 


7 


0 




■k-k 




2 


1 


1 


5 


TV-4,5 


13 


1 


0 




** 




10 


3 


0 


6 


TV-6. 


10 


4 


0 


7 


5 


1 


8 


5 


0 


7 


TV-7 


9 


4 ' 


0 


8 


6 


0 


6 


7 


M 


8 


S-2 


10 


3 


2 




** 




3 


1 


0 


9 


TV-8 


10 


4 


0 


8 


5 


0 


9 


4 


0 


10 


TV-9,10 


11 


.4 


0' 




■k-k 




8 


6 


0 


11 


TV-11 


n 


3 


0 


8 


5 


0 


9 


4 


0 


12 


S-3 


■ 9 


5 


0 




kk 




4 


2 


0 


13 


TV- 1^, lo 




4 


0 




kk 




6 


7 


1 


14 


TV-14,15 


9 


6 


0 




kk 




8 


5 


0 


15 


TV- 16 


n 


3 


0 


6 


5 


■2 


7 


5 


0 


16 


S-4 


7 


5 


0, 




kk 




1 


0 


0 


17 


TV- 17 


8 


5 


0 


6 


4 


2 


3 


8 


0 


18 


'S.5 


4, 


4 


4 




kk 






** 




TOTAL 




161 


67 


6 


51 


36 


5 


104 


6i 


5 



*TV - pretaped video program, S - live, interactive seminar 
**No 4-channel or laboratory. 
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TABLE 13 

CLASS RATING FORM SUMKARIZED ACROSS ALL PROGRAMS 



Part I " Televised Programs 



Item # Content Frequency Percentage 

1 Presentation mode most effective in helping 
you to understand today's program 



a) Instructor talking on screen 396 2U 

b) Classroom scenes, instructor describing 669 36% 

c) Instructor explaining charts 92 5% 

d) Teacher working with students 534 29% 

e) Interviews with experts or practitioners 164 9% 

2 Presentation mode least effective 

a) Instructor talking on screen 510 28% 

b) Classroom scenes, instructor describing 225 12% 

c) Instructor explaining charts 439 24% 

d) Teacher working with students 233 13% 

e) Interviews with experts or practitioners 410 23% 

3 Presentation more effective if altered 

a) Less material at greater depth 201 11% 

b) Less material because it was too much* 

to comprehend l62 9% 

c) ^More material relevant to central issues i^181 10% 
^ e) Coverage was adequate 1297 70% 

4 Discussion improved if more time spent on 

a) Theoretical aspects 52 . 3% 

b) Procedures for using materials 309 17% 

c) Examples of applications in classroom * 466 25% 

d) Adequate mix: theory, procedure and ^ \ 

application * 1023 55% 

5 Programs would be. better if less time was 
devoted to 

a) Theoretical aspects 371 20% 

b) Procedures for using materials 63 3% 

c) Fewer examples of classroom applications 96 5% 

d) Program was an adequate mix 1293 71% 



ERLC 
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TABLE 13-CONTINUED 



Item # Content Frequency Percentage 

6 Which one would make the moderator more 
acceptable? 

a) Enunciated more carefully ' 67 4% ^ 

b) If he understood more of the subject 22 ]% 

c) If he talked in a more natural way 297 16% 

d) Acceptable as is 1452 79% 

7 Improvement needed to make lecture easier to 
follow 





a) More explicit transitions between ideas 


81 


4% 




b) More careful organization of main points 


42 


2% 




c) Greater amplification of main points 


340 


18% 




d) More summary statements 


329 


m 




e) Acceptable as is 


1060 


57% 


8 


Effect of program on teaching 








a) Little or no relevance 


111 


6% 




b) Would like to use it, but probably won't 


208 


11% 




c) Would like to use it, but don't under- 








stand it enough 


179 


10% 




d) I plan to use it * 


1017 


55% 




e) Something I already know or am using 


338 y 


18% 


9 


More close-ups needed 






a) Yes ' 


132 


7% 




b) No 


1693 ' 


93% 


10 


Need*more close-ups of charts and written 








mate^als 








a) Yes 


580 


32% 




b) No 


1248 


68% 



n Need to hold written material on the screen 
longer 



a) Yes V 849 46% 

b) No 985 54% 
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TABLE 13--C0NTINUED 

A , 



I'^s'" f. Content Frequency Percentage 

12 Need to hold written material on less time 

a) Yes 76 4% 

b) No 1743 96% 

13 Pace of the program needs to move 

a) Slower 378 21% 

b) Faster 125 7% 

c) Acceptable as is 1323 72% 

14 Overall evaluation of TV program 

a) Excellent ' - 300 16% 

b'j Very good 740 40% 

c) Good 629 34% 

d) Fair 150 8% 

e) Poor 25 1% 

« 

15 Do you have a specific comment 

a) Yes 215 12% 

b) No . ' 1602 88% 
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portions of the course, though in looking at the data for individual 
programs there are some program specific suggestions which could be made. 

Of the three instructional activities rated on the Site Coordinator' 
Checklist- (Table 12), site coordinators rated participant satisfaction with 
the televised programs the highest, with 69% reporting high satisfaction, 
29% moderate satisfaction and only Z% indicating low satisfaction. These 
I'atings are in agreement with those made by participants on the Class 
Rating Form. 

Considering the ratings of Various aspects of the televised 
programs included in Table 13, the pace of thCprograms was rated as 
acceptable (72% responded this way on item 13). Ratings also indicated 
that the moderator was acceptable as he was (79% on item 6). Further, the 
level of coverage of the materiafwas adequate (70% on item 3), and there 
was thought to be an adequate mix between practical and theoretical 
information presented in the course (items 4-5). The presentation modes 
(item 1) thought to be most helpful in conveying information were class- 
room scenes with the moderatot;^roviding a description (36%) and classroom 
scenes of the teacher working with students with no voice-over moderation 
(29%). The presentation modes (item 2) that were rated least effective 
in communicating information were segments with the instructor on the 
set (28%) and interviews with experts and practitioners (23%). Of course, 
it must be remembered in items 1-2 that the students could only rate 
presentation modes that were used in the program being rated and that the 
presentation modes varied across programs. Thus, the ratings here reflect 
both the degree" of usage of the several modes listed as well as their 
perceived effectiveness. 

50 - - ' 
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Several items on Part I of the CRF dealt with rather technic^il 
features of television production. These were items 11-12, dealing with 
the amount of time written materials were held on the screen; items 9-10, 
dealing with the number of close-up shots used; and item 7, dealing with 
the presentation and treatment of main ideas conveyed in the programs. 
The overall response to all of these items was that the set of televised 
programs was adequate in all of these respects. Specific suggestions for 
revision may be obtained from the responses to individual programs. 

The final item from Part I of the CRF to be discussed is in some 
ways the most important. Item 8 asked: "What effect do you think today's 
program will have on your teaching?" 
^ /---^It is encouraging here that 55% of the participants said the 
^ inrbrmation conveyed in the program was something they planned to use in 
/ iheir classrooms, 18% of the participants were already using it, and only 
/ S% thought that it had little or no relevance to their own teaching* Some 
comments written by the participants as they filled out Part I of the CRF 
are includedjjj^low. '^^ 

"I thought the program was good. My only suggestion would 

be to take notes." * 

i 

"I felt many important points were lost because they were i 
covered too quickly." r--^ j 

"Please leave the written lists or charts on longer and ' 
have them a little bigger. The transmission of the program 
^ was fuzzy and some of the video was lost due to the small- 

ness of the wording." 

"One point - the program tends to speed through when 
listing materials or points, which makes the classroom 
scene sequences seem more tedious in contrast." 

"The program was very interesting and reinforced readings. 
Needed longer or slower presentation of analysis which is 
harder for me to grasp." 
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"I aRpreciated thd exposure to another section of our 
courfty school systfem but was pleased with the examples 
locally." \ 

"I felt that the lectures are very good, but I would like 
to see the important! surmiary statements be put on charts 
for a longer period df time. At times, the summary state- 
/ ' ments are presented sb quickly and I miss many important 
/ facts." - - 

"Great organization, b€|autiful presentation, but too fast." 

\ 

* Fotir-Channel Audio 

Part 11^ of the Class Rating Form queried participants about 
different features of the audio review segments. As shown in Table 14 
the overall participant evaluation (item 52) of the four-channel audio 
review activities was somewhat lower than that for the televised programs, 
(though the median response of 3.58 was again in "good" to "very good" 
range. Accordingly, ratings by site coordinators favored this same trend, 
with 56% reportingNhigh, 39% moderate and 5% reporting low participant 
satisfaction with jhis activity. As can be seen in Table 14, the technical 
features of the f/Dur-channel audio reviews— channel changing, volume, 
static, etc.,-Vere generally rated as excellent (items 41-45). However, 
there were problems at specific sites, especially regarding the presence 
of static or odd noises. Regarding the time allotted for choosing a 
respons^nd the number of items included each day, participants felt 
that yfe interval (item 45) was about right (76%) and that the number of 
items and the length of the items (item 48) was about right as it was 
(56%). There was some sentiment in support of increasing the number of 
items (35% chose a, b, or c on item 48). 
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TABLE U 

CLASS RATING FORM SUMMARIZED ACROSS ALL OCCASiDNS,, 



-part II ~ Four-Channel Audio 



Item # Content 

41 Hear nothing when button p 

a) Yes 

b) No 

42 Was the volume satisfactory? 
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Yes 
No 



Did you- ever not get the channel you 
selected? 



Frequency Percentage 



143 

807 



888 
62 



15% 

85% 



93% 
7% 



Yes 
No 



44 Hear two or more channels at once? 

a) Yes 

b) No 

45 Hear static or odd noises? 



Yes 
No 



\ 



46 Time interval for response choice 

a) Too long 

b) Too short 

c) About right 



47 Change to improve relevancy 

a) Content deal more thoroughly with 

concepts 

b) Content focus more on application" 

c) Content expanded oil relevant concepts 

d) Good as is 



76 

871 



128 
816 



222 
718 



204 
18 
723 



35 
109 

53 
747 



8% 
92% 



14% 
86% 



24%^-.'/ 



22% 
,. 2% 
76% 

4% 
11% 

6% 
79% 



ERIC 



53 



44 



^ABLE 14-CONnNUED 



Item # 


Content ^ 


Frequency 


Percentage 


48 


Imprpve four-channel audio segment 








ay riure uu u bnuruer lueins 


1 /IC 

1 4b 


15% 




riore Items or same leng^n as now 




18% 




c) More items of greater length than now 


22 


2% : 




d) Enough items, proper length now 


525 


56% 




e) Problem is not items, but use of audio 








segment as an instructional medium 


80 


9% 




iniprove quesuions 








a) Shorter 


118 


12% 




b) , Problem more clearly stated 


48 


5% 




c) Both a & b 


90 


10% 




d) Satisfactory length and clarity 


689 


73% 




xniprove aiternaLives 








a) Shorter 


174 


18% 




b) Longer 


25 


3% • 




c / rewer 


Co 






d) Good as is 


715 


m 


0 1 


iMiprove explanation or answers 








ay riure tnurouyn anu saine lenyLn 


^ \ 






b) Briefer, nx)re to the point 


1 16 






c) Longer and more thorough 


11 


3% 




d) Adequate length and coverage 


696^ 


74% 


52 


Overall evaluation of four-channel audio 








segment 








a) Excellent 


1 to 


1 0% 




b) Very good 


344 


37% 




c ) Good r 


324 


34% 


^d) Fair 


96 


10% 


e) Poor — ^ 


31 


. 3% 


53 


Specific comments 








a) Yes 


75 


8% 




b) No 


842 


92% 



Four items from Part kof the CM concerned the quality of the 
four-ctiannel questions. On item 49, 73% of the participants expressed the' 
^eelj^ng that the Items ware satisfactory in regard to length and clarity. 
The ^ifth and number of alternative answers (it6m 50) were also rated as 
satisfactory "(76%). In> terms of. the theoretical fersus applied orientation 
of the items, 79% of the participants felt that the items were acceptable 
as they v/ere. Regarding the length and level of coverage of the explana- 
tions of answers included in the '.four-channel audio review, ,74% of the 
participants felt that the materials were adequate in this respect (item 51) 

4 ^ The comments which^ follow^reflect participants' general .likes and 
dislikes regarding the f^ur-channel audio reviews. 

. ".I enjoyed the four-channel audio segment and found this 
^segment of the program very interesting." 

, "Jhere is an improvement in theTfour-channel over last 
summer. Changes have been madeS^ the better. The 
directions are briefer and- the questions are shorter and 
clearer." 

"The question and responses donotallow me to answer questions 
accurately. On many questions, I could not find an adequate 
response and was forced to choose the one that was the least 
false." 

"The alternatives were so ridiculous that they made the correct 
answer obvious. The choices would be more challenging if 
they were partially true and we were asked to choose the 
best of the four." ^ 

^ "I tKoLl^h^the four-channel segment very interesting and 

helpful. I wish th^e would, have been more questions 
to answer." 

"In my opinion, the four-channel audio segment is the least 
Jielpful of the components of this course— especially for all 
The time and effon of plugging in, etc*^ It' seems like a 

lot of 'trouble' just to answer four little questions which, 

* to me, could be more of a^* learning tool if read by the class 
,leade*8&and discussed among the group— or dispense with those 
questions altogether and let the class members use this time 
to discuss things that interest or puzzle them about the^lab 

• or lecture." 
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There were overtones in earphdnes of other answers due to 
technical problems, and. the deTay for selecting an answer 
resulted in a waste of time for me." 

« 

"Four-channel audio' was beneficial in that we were able to 
apply information and were given feedback." 

"I benefited greatly from the four-channel audio seqment— 
I would like the time on this segment to be increased." 

"The alternatives were too closely related and as I listened I 
couTd not see a great deal of difference in most of them." 

"I like the four-channel audio segment because it makes you 
apply what you have gotten in your readings and from the 
television lectures, but I do feel that there could be more 
questions given." <• 



Seminars 

>' — ■ . 

As presented in Table 15, the' median overall rating (3.58) for the 
seminars (item 89) was in the "good" to "very good" range. It is somewhat 
lower than the rating for the televised programs. 

Participants made several suggestions for improving the seminar 
format. They expressed a desire (item 81) to keep the length of the 
seminar at about one hour, but to allow a 15-minute, intermission (34%) to 
give students more time to generate questions. Too, participants suggested 
that they be given more opportunities to generate questions prior to each 

^^^^^^^minar program (24%).. Additionally, (item 83) participants felt that the 
seminars would be improved by beginning them wTth short content summaries 

^ , (38%) or new illustrations or demonstrations (23%). On item 82, most (62%) 
of the participants felt that the p'anel composition for the seminars was ' 
fine as it was, but 25% suggested the use of more teachers on the panels. 



^ 56 
ERIC . ^ 
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TABLE 15 

CLASS RATING FORM SUMf^RIZED ACROSS ALL OCCASIONS 



Part III — Seminars 



Content Frequency Percentage 

81 ^ Improve effect iven^s of seminar by format 

change 

a) 1 hr TV seminar and , 15 min intermission 219 34% 

b) 2 hr TV seminar and 15 min intermission 26 4% 

c) 1 hr TV seminar and opportunity to 

generate questions during and 15 min 

pribr to the program * 158 24% 

d) 1 hr TV seminar with direct voice hook- 

, , up 208 32% 

e) I hr conference call 35 5% 

82 Improve effectiveness o/^seminar 

a) Course instructor only 44 7% 

b) Use more teachers as guests 166 25% 

c) Use more professors and experts as guests 42 6% 

d) Fine as is :y ^ 405 62% 

83 Facilitate the generation of more meaningful 
questions 

aj^. Begin with 10 minute course content * 

summary ^ 245 38% 

b) Begin with'lO minute film of previous 

programs - . 67 10% 

c) Begin with short illustration of new 

demonstrations 151 23%' 

d) Use whole seminar for question answering 

and none for question stimulation 190 29% 

84 —Increase the value of the answers to the 

questions 

a) Less theory , 36 6% 

b) More classroom examples 141 21% 

c) More direct answers 157 24% 

d) Satisfied as is ' , 322 49% 
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TABLE 15--C0NTINUED 



Item § 



86 



87 



88 



89 



90 



Content 



85 Semfnar moderator more effective 

a) Keep guests more on topic 

b) Provide occasional surnmary 

c) Allow each guest equal time 

d) Keep a faster pace. 



Improve usefulness of q{iest*s presentation 

a) Not repeating themselves 

b) Keep on topic 

c) Allow them to express themselves better 

d) Relate answer to practical situation 

e) Excellent as is' 

Expected usefulness of follow-up answer via 
teletype or VHF 

a) - Yes 

b) No 

Advisability of continuing to answer 
questions via teletype or VHF 



a) Yes 

b) No 



Overall evaluation of seminar 

a) Excellent ' 

b) Very good ^ 

c) Good 

d) Fair 

e) Poor 



Specific comments 

a) Yes 

b) No 



Frequency Percentage 



85 
318 

53 
129 



45 

42 
30 
264 
274 



545 
70 



581 
56 



1D9 
242 
175 
97 
34 



109 
527 



15% 
54% 
9% 
22% 



7% 
6% 

5% 
40% 
42% 



89% 
11% 



91% 
9% 



17% 
37% 

27%r: 

15% 
5% 



17% 

83% 
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] The partigipants felt that the seminar moderator (item 85) could 

be iT^re effective in providing occasional summaries *( 54%) and keeping up 

the pke of the seminar (22%). It was also suggested by some (item 86) 

tliat the guestTThould relate their answers to more practical situations 

(40%), though 42% of th^ participants felt that the guests were excellent. 

Sentiments similar to those expressed toward the seminar guests were 

expressed in item 84 concerning the relationship between the quality of 

the seminars and nature of the answers to questions.' 

A final aspect of the seminar ratings related to the usefulness the 

transmission via teletype of answers to questions not included during the 

seminar broadcasts. Participants overwhelmingly (91%) responded (item 88) 

that this procedure should be continued and (item 87) felt that this was 

a useful activity (89%). 

General suggestions about the seminars are reflected in the following 

comments made by participants on the CRF. 

"Overall feel that this seminar (like the others ) was very 
interesting and enlightening. However, I do feel that some 
of the answers given were a bit 'idealistic'. (I'm basing my 
comment on my own experiences in six years of teaching plus 
those experiences related to me by other teachers.)" 

"Too many of the questions ;were similar. Also, much of the 
time was spent in answering questions which could be answered 
if people were reading their assignments. Isn't there some 
way of cutting out this type of question— or at least answering 
them without all of the students sitting through it. This 
simply drags the seminar out too long." 

"I feel the seminar guests were often too direct--giving a 
simple answer to a complicated abstract question. I also 
feel that many of the questions were not worthwhile—a fault 
of the students." 

' "The seminar was interesting and useful I I enjoyed the 
interaction between guests and moderator. It cleared up a 
lot of problems for me that Tve wondered about." 
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Someone should be screening the questions more carefully so 
the speakers do not have to keep repeating themselves over 
and over again*" 

"The speakers were not aware of the problems that exist in 
our area of teaching and therefore could not answer our 
questions adequately. The questions were not answered directly." 

"Questions relating to material already given by the project, 
such as simple definitions, should be omitted* You have provided 
us with the definitions of all the terms used. Your seminar is 
valuable, but should be screened a little more carefully," 

"I feel that the seminar would be more effective if the tele- 
type machine were not used during this time," 

"Most of us respond enthusiastically to the practical, down- 
to-earth answers and ideas of the teachers on the panel — 
or those who obviously work with children." 

"Seminars are too lenghty— hard to sustain interest for full 
hour. Perhaps have them more often and for shorter periods 
of time." 

"Guests' answers were not direct enough. They answered more 
optimistically than with a practical viewpoint. Teachers know 
they need to organize, but how? Guests need to have more 
practical suggestions for teachers who have no aides and f6w 
local resources." 



Laboratory Activities 



In terms of participant satisfaction with the instructional 
activities, the laboratory activities were rated below the TV programs 
and above the four-channel audio reviews, according to reports by site 
coordinators on the SCC. Reports of high, moderate and low participant 
satisfaction with the labs were 60%, 37% and 3% respectively. Table 16 
presents participant ratings from the Class Rating Form. As can be seen 
from the table, the median overall rating (3.36) of the lab activities 
was "good" (item 132). In regard to more specific questions, when asked, 
whether the activities were related to the topic (item 125),/ whether the 
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TABLE 16 

CLASS RATING FORM SUMMARIZED ACROSS ALL OCCASIONS 



Part IV — Laboratory Aqtivities 



Item # Content 

121 Use of materials from reference shelf 

a) Not enough time 

b) No need 

c) Used the materials a little 

d) Used the materials quite a bit 

122 Amount of time spent working in lab 

30 minutes or less 
45 minutes 
60 minutes 
90 minutes 
2 hours or more 



Frequency Percentage 



79 
823 
249 
158 



249 
253 
336 
320 
151 



6% 
63% 
}9% 

m 



^9% 

m 

26% 
ZA% 

m 



123 Improve lab by 

a) Coverin^'^re material 

b) Covering less material 

c) Lab was OK 

124 Clearer instructions are needed 

a) Yes 

b) Ho - 

125 Selected lab activities more related to 
today's topic 

a) Yes 

b) OK as is 

126 Need more time 



127 



Yes 

OK as is 



Make activities more applied and practical 

a) Yes . 
OK as is 



89 
252 
971 



231 
1059 



112 
1172 



209 
1091 



172 

1127 



7% 
}9% 
7A% 



9% 

9n 



}6% 
8A% 



}3% 

m 
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TABLE 16--C0NTINUED 



J"^^ ^ Content Frequency Percentage 

128 Require less material to be read prior to 
. class 

a) Yes 438 34% 

b) OK as is 858 ' 66% 

129 Require more relevant prior readings 

a) Yes 108 9% 

b) OK as is 1112 91% 

130 Need more relevant materials on shelf 

a) Yes 191 16% 

b) Adequate as is / ^ ^ 102O 84% 

131 Needed more useful homework assigned 
last week 

a) Yes * 141 ii% 

b) Useful as was 1091 89% 

132 Overall evaluation 

a) Excellent 134 11% 

b) Very good 415 33% 

c) Good 550 44% 

d) Fair 121 10% 

e) Poor - 31 2% 

•133 Any especially creative activities ' 

a) Yas > • 283 • 23% 

b) No. ^ • 955 77% 

134 Specific comments 

a) Yes 71 6% 

b) No 1140 94% 
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balance between practical and theoretical content was appropriate (item 127), 
participants overwhelmingly responded in the affirmative. In response to 
Item 130, 84% of the participants indicated that there were sufficient 
materials on the reference shelf; however, in item 121, 63% of the 
respondents indicated (across occasions) that there was no need to use these 
materials. 

* » 

A number of specific features of the lab were included on this part 
of the Class Rating Form, The median time spent working on the lab materials 
(item 122) was about one hour per class meeting, and 84% of the participants 
indicated (item 126) that this amount of time was sufficient. In item 123 the 
labs were felt (74%) to include an appropriate level of material coverage,' 
The amount of reading to be completed prior to class (item 128-129) was 
thought to be appropriate or perhaps (34% on item 128) a little too heavy, 
and the homework assigned after each class meeting (item 131) was thought 
to be useful by 89% of the participants, _ 

Participant comments regarding the laboratory sessions were as 
follows, 

"I feel that it would be more beneficial if we could spend more 
time during our 'labs' completing assignments on site—the^ if 
(and when) problems arise, we can get Immedtsrte feedback, which 
I feel would be more beneficial," . 

"I find the lab very confusing, I feel a need for more specific 
directions especially in receiving the materials." 

"I feel the ancillary packet is the best part 5f the course- 
seems to be very well planned and coordinated and we certainly 
do appreciate the amount of thought that has gone into gathering 
all the needed information so that we don't have to search 
frantically for all sorts of things— it's organized clearly 
and I appreciate its being basically 'self-contained'," 

"Having to share one set of materials is, difficult." 
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"There is too much material for length of time allotted* I 
believe more lab time would result in less confusion;" 

"The lab is very helpful for individualized reading." 

"There was really too much time provided for what activity 
we had to do." 

"I am getting, many ideas from the course. I don't mind the 
readings and generalization sheets, but after working all 
day at school , I feel that we are asked to do too much out- 
side work. I have a graduate degree and have taken courses 
in other states. This course has more outside work than 
any of the other semester courses I've taken," 

"It is hard to randomly sit down with someone and begin 
activities, especially when left to find our own groups 
(which wasn'tjtrue of today's lab). However, I would rather 
do some of th^se things with' another person, if they are 
^relevant and helpful (which is true of today's lab)." 

"The material covered is too much to do a good job with 
for the length of time that I can spend working on it." 

- How reliable was the equipment used in conducting the course? 

Three equipment systems were used to transmit the learning 
activities of the course. These were: 1) the audio-video delivery system; 
2) the VHF-teletype relay system; and 3) the four-channel audio review 
equipment system. These systems are depicted in Figures 2, 3 and 4, 
which follow, and are described in detail in Technical Report #5 (Bramble, 
Ausness and Freeman, 1975). 

As illustrated in the aforementioned figures, each of the three 
delivery systems was dependent on the use of either one or both of the ATS 
satellites for transmission of the various course learning activities. The 
pretaped video programs and the four-channel audio reviews were broadcast 
via the audio-video delivery system, which utilized ATS-6. The live 
seminars were also broadcast via ATS-6; however, questions to the seminar 
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FIG. 4 — FOUR-CHANNEL AUDIO REVIEW EQUIPMENT AT CLASSROOM SITES 
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panel were transmitted from the sites via the VHF-teletype relay system, 
' which utilized ATS-3. 

To gather information regarding the quality of reception and equip- 
ment reliability, the site coordinators were asked to complete the Site 
Coordinator's Checklist (SCC) after each class session (a copy of this 

instrument is presented in Appendix 1). The quality of reception ratings 

r 

from the SCC are sumnic(rized in Table 17. As shown in the table, signal 
quality was either excellent or* contained only minor distortion for 97.7% 
of the TV audip and 99.6% of the TV vj/deo transmissions. Too, the VHF 
radio transmissions were excellent or contained minor distortion 94.0% 
of the time. These ratings indicate excellent reported reception. These 
percentages are based on the totaJ number of ratings received each session, 
rather than on the total number of broadcasts received at each site. 

Specific equipment problems reported on the SCC are detailed in 
Table 18. As may be seen, the greatest number of problems was experienced 
with the teletype machine, which had a reliability of 88.6%. The TV 
reception equipment had the highest reliability, 96.8%, with problems being 
reported only 3.2% of the time." Reliabilities for the VHF and the four- 
channel equipment--were 91.8% and 96.2%, respectively. Some miscellaneous 
problems /elated to equipment and other sh^yf^t^ings of the course are 



detailed in Table 19. 

The reliability and reception quality for this course were the best ' 
experienced for all four courses offered by the AESP. From this it appears 
that most of the "bugs" in the system have been worked out. This high level 



of equipment performance l|j^Ressary if satellite transmission of educational 



programs is to become comnonplace. f 
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TABLE 18 

EQUIPMENT PROBLEMS FROM SITE COORDINATOR'S CHECKLIST 

SUMMED ACROSS SITES AND SESSIONS 
(BASED on 99% RESPONSE RATE FROM SITE COORDINATORS), 



Equipment 



Frequency 
of Problems 



Percentage 
of Problems 



TV reception equipment 

Parabolic antenna 

2.6 GHz receiver 

TV monitor/receiver 
VHF reception equipment 
• > Helical antenna 

VHF console 
• Teletype equipment 

Machine 

Teletype line 

EIA interface (teletype to ATsi-3) 
4-channel equipment 

Connections and/or interconnecting cables 



1 
4 

3 

-3 
4 

20. 
6 
3 

4* 

2 



\.^% 
1.2% 

3.55^ 
4.7% 

7.8% 
2.4% 
1.2% 
3.8% 
.8% 



Note: Percentages based on actual number of problems divided number 
of possible uses of equipment. All equipment could be used at 
least 255 times (17 programs times 15 sites) except, for VHF 
equipment (85 times, 17 programs times 5 sites) and' 4-channel 
(105 times, 7 programs times 15 sites). 

,*One problem with the piaster audio unit and three problems with the 
cassette tape recorder^- 
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TABLE 19 


SUMMARY OF MISCELLANEOUS PROBLEMS FROM SITE COORDINATOR'S CHECKLIST 


Nature of Probl,em 

^ 


Session^ (number of sites reporting) 


Delay in program broadcast* 


7(8). 12(3). 14(1). 15(2). 16(1) 


Low attendance** 


5(1). 6(2). rO(U^ll(2). 15(1) \ 


Cancellation or postponement of 
class*** 


4(3), 5(1) ^ 


Missing laboratory materials**** 


. 5(1). 6(1). 7(5). 8(1)' 


Missing evaluation materials***** 


3(1). 



*Due to problems at Rosman uplink station for session 7. or due to weak 
reception problems (loose connections, etc.) 



**Reasons given either weather, illness or ball games 

♦♦♦Reasons given were 1) weather and 2) loss of audio signal 

, ♦♦♦♦Problems were 1) insufficient copies of one text book. 2) missing 
a cassette tape for the miscue analysis. 3) missing lost section of 
laboratory assignment (3 sites) and 4) insufficient. copies of laborato 
assignments 

*****Problem was insufficient .copies of class rating form 
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^'How valuable were the\inforniation systems that were available 

to the course participants? 
To gather infomiation regarding the above question, the DPRI 
Information Systems Questionnaire (ISQ) was administered to the participants 
on the last da^Mjf^ass^^ had two parts: Part I consisted of 

ten Likert type statements, and Part II consisted of 22 multiple-choice 
questions (a copy of the ISQ is presented in Appendix 1). 

Part I contained five items that related to the usefulness of the 
Select-Ed information system and five items that related to ti\e Kentucky 
information system/ These ten items were factor analyzed and twb\factors 
(eigen values greater than 1.0) were found. The VARIMAX rotated fac^br 
matrix is presented in Table 20. Items were assi^ed^to a factor based 
on the largest loading for each item. The items includ^^^on^eaclif actor, 
the factor names, and the factor means are presented in Table 21. ^ 
As shown in Table 21, the factor mean (per item) was 3.80; this 
indicates ^that the manuals and request forms were adequate and clearly 
written and that if available, participants would \Tse these information 
systems. The mean of factor 2 was 3.40. ' T^s is a somewhat positive 
rating but is a little less strong than the rating for factorM^This 



indicates that the participants wer^< moderately positive toward th^value 
of the information provided in the searches and that the searches were. ^ 
easy to interpret. 

Part II of the ISQ consisted of 22 mul ti pi e-choice( items. In 
Table 22 are presented the frequency and percentage of respoi^ses to the 
alternative choices for each item. This information^ftdicatek that the 
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TABLE 20 ^ 

FACTOR ANALYSIS OF LIKE^T ITEMS ON DPRI INFORMATION SYSTEMS QUESTIONNAIRE 

(N=107) 





VARIMAX Rotated Factor Matrix 






Question 






Mean** 


sd 


Factor 1 (87.6%*) 


Factor 2 (12.4^*) 


1 


^ 

.686 


.464\ 


3.71 , 


J 


2 

3 ■ 


.686 
.246 


.699 


3.68 \ 
3.37 


1.22 


4 


.311 : 


.680 


3.47 


^i^os^ 


5 


.801 


.219 


3.97 


1.17 


6 


.725 


.274 


3.78 


1.05 


7 


.716 


.455 


3.76 


1.09 


8 


.261 


.840 


3.34 


1.13 


9 


.474 


.663 


3.41' 


" 1.02^ 


10 


.757 


.256 


3.88 


1.21 



*Percentage of common variance 



5-point Likert scale — 5 = strongly agree, 1 = strongly disagree 
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TABLE 21 

FACTOR MEANS FOR LIKERT 4TEMS ON DPRI INFORMATION SYSTEMS QUESTIONNAIRE 

(N=107) 



Factor Name 



Items Included 
on Factor 



Factor Mean 
(sd) 



The manual and request forms were 
1 adequate and clear, and I would 
use the information systems if 
they were available to me. 


1,2, 


5-7, 10 


3.80 (.47) 


The information searches provided 
2 me with useful information and 
were easy to interpret. 


^3, 4, 


8, 9 


3.40 (.55) 



participants did not make much use of the information systems except as 
specificially required to do as part of the course requirements. Only 16% 
used the Select- Ed system more than the one recfuired time, and only 37% used 
the Kentucky System at all (items 11 and 12). The participants were allowed 
to use the information systems as much as they desired to gather information 
they could use in their reading classes. However, only about half the 
participants reported being aware of this opportunity (items 26 and 27), 
and only 58% reported that their site coordinator encouraged them to use 
the systems more (item 28). This helps explain the low usage rate and 
points toward a need for more emphasis to be placed on encouraging site 
coordinators to familiarize themselves with such systems so that they can 
aid and encourage participants to use them. 

Questions 13 through 25 on the ISQ attempted to find reasons for 
the low usage rate and to identify suggested improver^ information 
systems usage in the future. Generally, the parti ct^anX^^elt that the 
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TABLE 22 

FREQUENCIES AND PERCENTAGES FROM DPRI INFORMATION SYSTEMS QUESTIONNAIRE 



Item Response Frequency Percentage " N 



1. 


227 


84% 




2. 


26 


10% 




3. 


5 A 


2% 




4. . • 


7 


2% 




5. 


4 


1« 


269 


1. . 


162 


64% 




2. . 


- 78 


31% 




3. 


9 


4% 




4. 


3 


1% 




5. 


3 


1« 


255 



Items 13 through 15 were answered by participants who did not run more than 
one assigned search using the Select-Ed system and are concerned with their 
reasons for mt doing so. 



13. 1. 

2. 


92 

121 


43% 
57% 


213 


14. 1. 

2. 


27 

173 


13% 
86% 


200 


15. 1. 

2. 


26 

173 


13% 
87% 


199 


Items 15 through 18 were answered by participants who did not run any 
searches using tfHe Kentucky System and are concerned with their reasons 
for not doing so. 


16. 1. 

2. 


79 
72 


52% 
48% 


151 


17. - 1. 

2.. 


29 
121 


19% 
81% 


150 


18. 1. 

2. 


17 
134 


11% 
89% 


151 
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TABLE 22-CONTINUED 



Item ' Response 


Frequency 


Percentage N 


Items 19 through 22 were answered yes if the participant thought the 
suggested improvement would be of benefit, and answered no if he thought 
it would not. 


19. 1. 

2. 


82 
161 


34% 

66% 243 


20. 1. ■ 
2. 


82 
159 


, 34% 

/ 66% " ' 244 


21. 1. 

2. 


112 
128 


47% 

53% 240 


22. 1. 

2. 


126 
115 


52% 

48% 241 


Items 23 through 32 asked the participants to respond to a variety of — 
questions regarding information system utilization. 
"Would you have utilized..." 


23. 1. 

2. 


210 
41 


84% 

16% 251 


24. 1. 

2. 


232 
24 


91% 

9% 256 


25. 1. 

2. 


190 
66 


74% 

26% 256 


"Did you know. .." 






26. 1. 

2. . 


148 ■ 
106 


58% 

42% 254 


27. " 1. 

2. 


114 
129 


47% 

53% 243 


28. 1. 

2. 


144 
105 


58% 

42% 249 
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TABLE 22— CONTINUED 



Item Response 


Frequency 

• 


Percentage 




"Did you incorporate.-." 








2Q 1 




38% 








62% 


237 


"^n 1 


CO 

bo 


27% 




L • 


1 OH- 


73* 


212 


31. 1. 


1,08 


46% 




2.' 


125 


54% 


233 


32. 1. 


31 


25% 




2. 


31 


■ 25% 




3. 


13 


10% 




4. 


6 


5% 




5. 


• 45 


36% ' 


126 



manuals and procedures for running searches were adequate (items 14, 17, 
19 and 20). However, the majority felt that further training for the site 
coordinator and an improved video program devoted to the usage of the 
information systems would be helpful (items ^1 and 22). 

A major problem appeared to be that since the informafion systems^ 
provided only references rather than the actual materials, the participants 
were reluctant to use them. Although this was not reflected in the 
responses to the two items that specifically ask that question (items 15 
and 18), 70% to 90% of the participants reported that they would use the 
systems more if the materials recommended by the searches were immediately 
available at some convenient place (items 23, 24, 25 and item 32). 

That the information systems were valuable is reflected in the fact 
that half the participants looked up the materials suggested in the searches 
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they ran (item 31), and about a third used these materials in their classes 
(items_29 and 30). With more training for the site coordinator, an 
improved video program explaining information system usage, and easy 
access to recommended materials, the usage rate of information systems 
might be increased* 

- What was the overall rating of the course? 

The answer to this question was obtained from the participant and 

site coordinator responses on the Summative Comments Form. On Part II of 

. this form, 246 of the participants rated ten features of the course. 

Means and standard deviations for these ratings (on an eight-point Likert 

scale with one being highest are presented in Table 23. The means range 

^^Trom ^Jlj^ of^2.086 for thje, performance of the site coordinator to a low 

^ 4.043 (slightly above neutral) for the interactive seminars. Features 

of the course receiving the highest ratings were the performance of the 

site c5^rd4^wJ:iir^ the taped TV programs, the seminar host and guests, 

the follow-up activities,^^lmd-Uie on-site reference materials. All mean 

ratings were on the positive end of the^^si^i^bijXJeatur^ 

were the interactive seminars, laboratory acti^TfTes, four-channel audio, 

information systems and preprogram preparation. 

Illustrative comments from the course participants shed some^ght 

on the interpretation of th^e ratings. For example, regarding the' 

participant's very positive ratings of site coordinators the following 

comments were re;:^*ved: / 

"Had good organization, knowledge, contr^ of sv^tem and 
gave attention to all students." ^ ^ 
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TABLE 23 



MEANS AND STANDARD DEVIATIONS FOR SUMMATIV.E COMMENTS FORM, PART II 

(PARTICIPANT RATINGS) 





Items 


Mean 


sd 


N 


1. 


Preprogram preparation 


3.142 


1.584> 


254 


2. 


TV program 


2.850 


'1.749 


254 


3. 


Four-channel audio 


3.219 


2.197 


260 


4. 


Laboratory activities 


3.529 


1 .796 


257 


5. 


On-site Reference materials 


3.016 


1.681 ; 


253 


6. 


Televised, interactive seminars 


4.043 


2.244 


/ 

257 


7. 


The seminar host or guests 


2.930 J 


1.599 


257 


8. 


Information retrieval systems 


3.165 


1.798 


237 


9. 


Follow-up activities 


\2.964 


1.607 


253 


10. 


The site coordinator n 


I 

2.086 


1.381 


256 



8-point Likept sca^le — 1 = outstanding, 8 = unacceptable 

"The site coordinator is to be conmended for keeping the class 
^organized and focusing on the specific purposes designed for' 
the course." 

"He (the site coordinator) initiated good discussions and 
created an informal atmosphere in the classroom which made 
everyone work better together. I feel that because of this 
feeling in the classroom, everyone really enjoyed the course." 

"With this type of planned, programmed class, the site 
coordinator is not given a chance to be a leader. There is 
not much 'programmed' for the site coordinator to do." 

Other valuable comments were received from the participants about 

the course features that received low ratings. For example, the students 

complained that the main weakness of the seminars was th?(C^ey were not 
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practical enough and that the guests often^pokeTTrter 
than practice. 

"They (the seminar panelists) were idealistic and Jave no 
guidance for the classroom." 

On the other hand, participants did appreciate the presen(je of ^"experts 
to discuss certain topics covered. in the course. 

Regarding the lab activities, except for activities involving group 

interaction, participants thought the activities would have been more 

meaningful if completed at home. 

"Usually the work was done before class. I enjoyeji our 
class discussions and sharing of activities/' 




"It was interesting to hear the other teachers' id 

"Not enough activity in class— need more interacti 
participants." 



l3as 

on among 
reviews. The 



The four-channel audio, instruction received mixed 
following participant comments illustrate the differing [3erceptions of this 
activity, 

"Very good method of check-up quiz." 

"The four-channel audio was very informative and \'ery 
useful . I loved iti" 

"The four-channel audio was a waste of time. Our equipment 
usually didn't work." 

"Some choices were rather ridiculous, making the :orrect 
answer obvious." ^ 

"It should have been longer.* I liked the basic idea of 



/ 



teach and reinforce, but it could be expanded to 
useful." 



be more 
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Comments about the information retrieval systems stressed that the 
length of turn-around time was too long. Participants were apparently too 
unfamiliar with the nature of the information available to make useful 
judgments about its value. Regarding the on-site reference libraries, 
participants commented that the ready availability of the materials was 
nice, but that some materials were not needed and conversely some needed 
materials were in short supply. This indicates that more specific informa- 
tion on materials usage is needed if meaningful changes are to be made in 
this areSi. 

The site coordinators ^al so rated the first nin'e features of the ^ 
course on Part II of the Summative Conments Form. The means and stan^rd 
deviations for these ratings are given in Table 24. However, due to the 
limited sample size, the means in this table are much less precise than tlje 
means in Table 23. The site coordinators rated the TV programs, seminar 
host and guests, preprogram preparation, on-site reference materials, 
follow-up activ^'ties and the lab activities as the most positive features 

4 

of the course. The seminars, four-channel jiudio instruction and 'the 
information retrieval systems were rated poarest. Thus, the site 
coordinator ratings of course features are riot unl^jke the participant 
ratings of these same features. Too, comments from the site coordinator^Z 
.generally paralleled those of the course participants. However, the site 
coordinators were more concerned "With difficulties of an organizational 
or scheduling nature and with problems of understanding instructions for 
lab activities and the use of the information systems. 

The first item on Part I of t^e Summative Conments Form allowed the 
participants to identify specific television programs that they liked or 
disliked. The frequencies with which programs were mentioned are given in 

81 
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TABLE 24 ♦ 



SITE COORDINATOR RESPONSES ON THE SUMMATIVE COMMENTS FORM 



em Topic of Rating ' Mean sd 
> . ji_ 



1 Preprogram Preparation ^ 2.29 2.14 ^ 7 

2 TV Program . ^ ^ 1.75 .71 ■ 8 

3 ^ Four-ChanneT Audio 4.75 1.67 8 

4 Laborator^Activities 2.88 2.36 8 

5 On-site Reference Materials 2.33 1.00 9 

6 Seminars 4t25 2.71 ' 8 
Seminar Host and Guests ■ ./ 2.00 .87 9 

8 Infofma|?iori Retrieval Systems 4.89 2.26 9 



9 Follow- up Activitjes - 2.33 1.87 9 

— \ ^ 

in Table"257 As shown in the table, the most liked programs were 7 
(Prescriptive Instructional Systems), 16 (Developing Life-Long Readers), 
2 (Informal Tests), 14 (Comprehension), 3 (Standardized Igsts) and 15 
(Reading in the Content Fields),. In interpreting these findings, the most 
important factor that each of these programs had in common concerned the 
content or topic. The content of each of these programs was fairly familiar 
to teachers and concerned tests and teaching practices they had had some 
experience in implementing. Too, the presentation mode in each of these 
programs was similar—a considerable amount of classroom filming with 
voice/over explaining the use of these techniques. In contrast, the least 
liked program was disliked for several reasons: it tried to cover too much 
complex information about administering, scorings and interpreting the 
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TABLE"25 

PARTICIPANT RESPONSES ON SUMMATIVE REPORT- FORM 



rt I — Item 1: Participajit Ratings of TV Programs 




Program ^ 
1- DPRI introduction 
Informal tests 

3, Standardized tests 

4, Word recognition tests 

5, Comprehension and study skills test 
,6, Miscue analysis 

7, Pre^riptive and instructional systems 

8, DPRI nfeoagement , 

9, Reading readiness and beginningNceading 
10, The exceptional reader 

Word recognition.. 
Vocabulary 
St^dy skills 





T4, Comprehension 



9 



15, Reading in the cor>tent ffelds 

16, \ Developing life^obg readers ^ 
^^J.Z<^ Total reading program 



Frequency Frequency 



Liked 


Disliked 


b 


0 


19 


0 


15 


. 1 


■ 5 


0 


3 


0 


10 • 


39 


^ 31 


0 


9 • 


1' ^ 


■ 13 . 


1 




1 


11 


0 / 


1,6 . ■ ^\ 


0 






10 


1 


17 


0 


14 ' 


0 . 


zz 


0 




1 
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Reading Miscue Inventory, something which most participants had had no 
sxperience with or did not previously understand. The teachers felt that 
this instrument was too complicated to use in their classrooms anyway and 
that if the course was to cover this topic, participants felt there should 
have been at least two programs devoted to Miscue Analy§is. 

Item two, ^n Part I of the SCF gave the^Darticipants an opportunity 
to suggest particular revisions which might lead to^-ijjjprovenients iTTthe-^ 
programs. These suggestions are summarized in the resul t^^s^t^'on irk the 
participant comments about the TV programs . -^n-§eft^ral , participants^eH, 
that the pace of most programs was too fast -for the amount of material 
covered. They suggested that more content sumnaries be included so that 

important concepts received the proper stress. 

* \ - 

Participants were asked in item three if they would recommend thfs 

course to their peers. Of the 246 respondents, 238 said they would while 

only 8 said they would not. This ihdicates^at the overall course rating 

was positive. In item four, the participa^s were asked to make specific 

recommendations for the overall improvement of the course. The follovi(ing 

comments are representative of those received. 

^"I wj^sh there was some way we could' develop in depth each 
concept which has''been presented. Too much was offered." . 



"More specific activi«es,.for teaching skills; more detail 
of reading programs -xjTAi>DISTAR)." ' 

"Seminars tend- to become tK)ri ng whep students have to listen 
to answer^ to everyone elsVs ques^'on *hat do not apply 
to them, rt would prQbably\e morr practical, to send back 
answers to questions through teletype only."- 



\ 



"Less material vshftuld be given. \l feH that f was lost 
with so fiiany ditfetent materials. \ 
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"I think the course had too much 'busy' work^ I wou>d have 
gotten more out of the course by discussing all. these acti- 
vities without writing them down* We are professionals and 
^should be treated as such." 

"The course covered a lot of material. I think It would be 
nice if you could now take single or paired programs and 
elaborate on them--management, exceptional learners, word 
attack skills, etc." 

"I feel that many of the ancillary activities could be done 
\ on our own time." 

"We. could Qse'^more live seminars and group interaction."^ 

"I felt during the lab sessions teachers shared ideas and 
material s^tliat worked for them. This worked excellently 'at 
our site." 




CONCLUSIONS 

' . The DPRI-6 Course, the fourth course offered by the AESP, 
was an effort to coordinate and perfect the stanc^ard features cortwon to 
an AESP courses. In addition, this course'was somewhat of an experiment 
in that it offered students three course content options from which to 
choose, making this course more flexile, yet at the same time more tailored 
and content specific than previous courses. , \^ 

Based on the information presented in th^ results section, the siiEe^ 
coordinator and participant evaluations of this course lead to the following 
conclusions: ^ 

The particular course option chosen by the participant 
did not affect pre-to-post achievement gain. As was the case 
in the past, signifiwnt pre-post differences on the achieve- 
^ 'ment variable were due to factors at individual sites. Howr 
^ever, the postcourse achievement scores 4*evea led nlj significant 
differences attributable to either triangles or sites* 

The postcourse achievement mean of over 70% was quite . 
high. From this it can be inferred that participants mastered 
the course materials. 
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J^re was a small (non-signi f leant ]hn^ gain in attitude 
as a result of this course. However, since the precoXirse means 
were very positive, an insignificant gain in attitude is under- 
standable. ^ 

The ratings of the ten course features were similar to 
those of previous AESP courses. All ratings were positive, 
but there was a definite preference for certain activities. 
As in the past, the features most liked were the taped TV 
J^rosxm^^he-site^ coordinator, the on-site reference materials, 
and the seminar host and guests. There was also agreement 
with ratings for the other coik^es on the least liked 
activities: the four-channel audio reviews, the seminars 
and the information^ystems. The labs and the preprogram 
activities were rated more positively by site coordinators 
than by^ participai\ts. 

/ , 

The data suggest that the best-liked television 
programs were tijose which contained a balance of theory and 
practice. Tf)/^programs which were too abstract or xovered 
. too much material were disliked by participants. X 

Although participants seemed to understand that the 
site coordinator's role was not that of instructor, their 
comments sugges-t that site coordinators need more training 
as facilitators. It was mentioned frequently that the sfte 
coordinator should be well versed ><-n tbe utilization of 
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information retrieval flystems so that he or she could encourage 
the use of these systems. Too, the site coordinators should 
take a more activite role in insuring that labs are organized, 
that students know what they have to do, and that the activities 
run smoothly. 

Even though the seminars were not rated as highly as 
the taped programs, participants thought that the idea of an 
interactive seminar was, in itself, valuable. However, 
participants did not feel that the project made optimal 
use of its seminar time/ They thought that a more efficient 
system for the relay of questions and a better process for 
screening questions were reeded. Too, they suggested 
that the seminar moderator take a more active role in guiding 
the discussions. 

The sharing of ideas and experiences provided for in 
the laboratory seissions was thought to be one of the most 
/valuable aspects of the course experience. It seems that for 
f future courses, the lab sessions should be less ^^^^fygvmmed'^ ^ 
aYid the workload more evenly distributed scr as to maximize 
oppf^rrtunities for in-class interaction. Participants- valued 
the field work completed as part ofAthei^* foTfow-up work 
and suggested that more activities. of an applied nature ^ 
should be incorporated ifi^ thd^j^urse. ' ' - ' 
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Participants felt that the information obtained from the 
information retrieval systems was valuable. They suggested 
that with more traihing for the site coordinator, an improved 
video^progriam and easy access to recommended materials, the 
usage rate of the information systems could be increased. 

Regarding the equipment, the reported quality of 
reception and equipm^t reliability was excellent, 
better than in the previous"" three courses'. This high level 
of equipment performance is essential to the acceptance of 
education by satellite. 

J The participants considered the overall course 

experience valuable. They would tjake it agai^j, knowing what 

they now know about the course. 
i 
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APPENDIX 1 

Combined Attitude and Background Questionnaire 
Site Coordinator' ^ Checklist 
Class Rating Form 

DPRI Information Systems Questionnaire 
Summative Comments Form ^ 
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Appalachian Education Satellite Project 

Resource Coordinating Center 
306 Frazee Hall, University of Kentucky 
Lexington ; Kentucky 40506 



COMBINED ATTITUDE AND BACKGROUND QUESTIDIiNAIRE 



: This questionnaire"-is,..4iv^ into 2pgct5?^'rhe first part is concerned with 
your attitudes towards reading/'lina' "tB6' Seco^^^&t asks for some background infor- 
mation^ Please answier as truthfully as pj^s^rfble. Your answers do not affect your 
in the course^'but help us to ass^s the effectiveness of the co^Dt^ and 
St improvements. 

Be sure you have a pink Op-Scan form titT&cL^eneral Coding Form". Write 
ix name on the upper left hand comer of* the form.^ViJJL^ out columns 1 through! 9 
AS indicated by the diagram. , ^ 



• 0 • 


• 0 » 






• 0 • 


•0 • 


• 0 • 


• o» 


• 0» 














• \ • 


• \ • 


• \ • 
















• 1 • 


• f 




♦ 3 • 




• 5 • 




• J • 


• 




• % • 




•4 • 








• 4> 












































1 

r . ' 


2 


3 


4 


5 


6 


7 


8 


9 




a 4 if K-3 

5 if 4-6 

6 if K-6 



in column 2-5 fill in 6001 

in column 6-9 fill in YOUR four digit 
student number 



Start your answers in column 31. Use a soft-lead (#2) pencil to mark the 
answer sheet — do not use a pen or balL-:point. Connect with a heavy line , the 2 



dots between which your response number lies: 
make a mistake, b^ sure that^ you erase 
completely. Do not make any other^'^ma^cs on 
the answer sheet. 



If you change your mind or 



For each statement in the first part ma 

1 if you COMPLETELY DISAGREE with the statement 

2 ^ if you MOSTLY DISAGREE with the statement 1 

3 , if you MODERATELY DISAGREE with the statement 

4 ^ it. you SLIGHTLY DISAGREE Vith the statement 

5 if yo\i^ SLIGHTLY AGREE with the statement ^ 

6 ,if Vou^ M^QgRATELY AGREE with the statement 
jp if you MOSTLySrGREE with the statement 




8 *if you 'completely AGREE with the statement ^ i? 



Note: The first alternative in the pp-Scart 
to mark '0' ,if you mean to mark '1*. 

The second part of the questionnaire asks tor background i* 
infotmation obtained is potentially very helpful in conducting 
evaluating its usefulness. Please answer all questions on 
does not apply or if you cannot remember the information 
is kept confidential. 

31. Reading instruction should focus more on reco- 
page than pronouncing words. 

32^^ One responsibility of the primary reading teacher is^to expose students to 
different kinds of experiences. 

33. An^analysis of oral reading miscue^^s more trouble than it's worth. 

34. Reading should be integrated with all other classroom activities. "^^^^^ 

35., Contingency contracting £s a method that lets children "goqf off" and not make 
good use of their -time in school. 

36. There's nothing ♦a 'teacher can do to develop reading readiness in students. 

37. Information sy3tema^inking diagnosis and instruction are effective ways to^ 
plan instructional activities. ' * . 

38. V6c#5ulary should be taught through real life experiences. 

39. Grouping children on the basis of common skill needs Is better than grouping 
them on the basis of instructional level • 

40. Students 'in your class should all read the same thing, so no one feels bad. 

41. ' Teachers only need to diagnose fetudent needs in the fall of the year. 

42. ,The emphasis given phonics changes according to student needs. ^ 

' p, < 

43- Diagnosing student reading problems is the responsibility of the teacher, rather 
than the schoojL administration. \ ^ ' , 

44. Infopnal tests are better than sttodardized tests fdi; placing students at . 
appropriate levels, ^ ' ^ ^ ^ 



45. Prescriptive instructiion is the best way to teach* reading. . * 
46.. A child should read all the way through every book she ^akes out pf the library. 



^ 47, Kindeif^rten teachers do not^have to worry about teaching stxiStents to und^r- 
* stand stories. > ^ ' . , - 

• - - — - \ • 
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48. If a class i6 large, there's no way to work with individuals. 

49. A third-grade teacher only needs third-grade instructional materials. 

50/ Khowing how to understand a graph or table is an aspect of social studies and 
■ NOT an aspect of reading instruction. 

51. A student is a good reader if he can read every word correctly. 

52. Not using every page in the workbook is wasteful. 

# 

53. Scores on standardized tests provide adequate information for instruction. 

54. If a child is not interested in rehding, there is little a teacher can do to 
generate enthusiasm. • * 

55. Time spent diagnosing could be better spept' instructing. * 

56. If you don't have enough books for all your students, you cannot ^effectively 
use a set of materials. , / 

( 

57. There is go giuch material to cover in school that taking time to let children 
do "free reading" Is not productive. 

58. Sex 

^ 1. Male' , ' ^ 

2. Female ^ - ^ 

. ^ ^ . ! 

59. Description of community in which you teach (or work in some other area of 
education) 

1. ^ Rural 

2 . * 'Suburban 

3. Urban ^ ^ 



60. Age in years as of last birthday 

,1.' 21-23 ' . • 

, 2. 24-26 ' \ \ ' 

3. 27-30 

4. 31-40 . ' ' ^ 
51 41-50 

6. 51-60 

7. 61 or over 
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61» Score on GRE Verbal (leave blank if you have not/ taken it or do not remember 
score) 



1, 


400 or below 


2, 


401-450 


3- 


45^-500 


4. 


561-550 


5, > 


/551-6OO 


T 


601-700 




701 or above 



Score on GRE Quan^lrt^ 
remember score) 

1, 400 or below 
2: 401-450 

3, ^1-500 

4, 501-550 
•5, 551-600 
/fe, 6()l-7O0 

7, 701 or above 



tive^ (leave blank if you piave not taken it or do not 



\ 



\ 

'63* ' Position during 1974-75 academic year 



1, Classroom Tether 

2, Reading Specialist 

3, , Special Education Teacher 

4, Counselor . 
Principal 

6X School Administrative Position (other /than principal) 
7, \lther 



/ 



64. ChoQse tSe grade range that closely appirdximate s the grades you work with 



1. Elementary- all grades 

2. K 



3. 
4. 
5. 
6. 
7. 
8. 
9. 



1 
2 
3 
4 
5 
6 

7-12 




65. wbtk experience in teaching 
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1, 1 year or less ^ 

2, 2-3 years 

3, 4-5 years 

4, , 6-8 years 

5, 9-10 years 

6, 11-15 years 

7, 16-20 years 

8, 21 years or more 
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66. Experience as a Reading Specialist 
1 . none 

^2. 1 year or less 

3. 2-3 years 

4. 4-5 y^ars 

5. 6-7 years - " 

6. 8-9 years 

7. IQLor more years 

67. Are you taking this course for credit? 
1. Yes 

-2. No ^ 

<* 

68. If you have registered for credit where would you like to obtain credit? 
(leave blank if not registered for credit) 

* t 

1. University of Kentucky 

2. Other College or University 

69. What was your undergraduate grade-pOint average? (convert to four-point scale 
where A = 4) 

1. less than 2. 25 

2. 2.26-2.50 

3. ^.51-2.75 

4. 2.76-3.00 

5. 3.01-3.25 

6. 3.26-3.50 

7. 3.51-4.00 

70. What was your graduate grade-point average? (convert to four-point scale 
where A = 4) 

1. less than 3.00 

sr. 3.01-3.25 

,3. 3.26-3.50 I . . 

/ 4. 3.51-3.75 ^ 

^ 5. 3.76-4.00 

71 Last degree completed^ 



1. High School Diploma 

2. Baccalaureate 
3« Master's 

4. Specialist 

5. Doctorate 
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72. Number of undergraduate reading courses the major emphasis of which was 
reading instruction. 

!• none 
2-1 

3. 2 H 

4. 3 

5. 4 — 

6* 5 or more 

73. Number of graduate reading courses the major emphasis of which was reading 
instruction 

1. none 

2. 1 . " 

3. 2 

4. 3 

5. 4 ' . 

6. 5 or more 

74. If you are currently enrolled in a college program which of the 
following best describes your purpose? 

1. Baccalaureate degree 

2 Master's degree 

3. Specialist degree 

4. Doctorate 

5. Enrolled but not in a degree program 

6. Enrolled in courses to maintain tCjaching certificate 

7. Not enrolled 
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Program # 



SITE COORDINATOR'S CHECKLIST 
Site # 



Date 



Person Completing Form 



Check each piece of equipment with which you had trouble during the past week. 



Parabolic Antenna ' 

Helical Antenna 

Conneotions and Interconnecting Cables 

VHP ci)nsole 

2.6 GHz Receiver 

TV Monitor/Receiver 

Teletype 

a* Machine 

^ Telephone Line 

c. EIA Interface 



Xerox 400-1 Telecopier 

4 -Channel Equipment 
a. Headsets 

Student Selector Boxes 

c. Connectors and Cables 

^ Master Audio Unit 

e* Cassette Tape Recorder 

No Eqxiipment Trouble 



The following items 'refer to today's class (check all that apply) 



Audio Signal: 



Video Signal: 



TV Audio 
(ATS-6) 



VHF 4-Channel 
(ATS- 3) 

' None 

Poor 

Major Distortion 

Minor Distortion 

Excellent 



There was a delay in program broadcast 
Low attendance. State probable reason 



None 
Poor 

Major Distortion 
Minor Distortion 
Excellent 



Cancellation or postponement of class. State probable reason 



Missing lab materials 



Missing evaluation mateijials 

Student satisfaction 



with 1 program 

' High 

Moderate 

Low 



with 4~channel 

High 

Moderate 

Low 



Lab materials 

High 

Moderate 

Low 



In the space below and on the back, write the reactions and suggestions made by the 
students about today's* activities. Include any suggestions, special problems, or 
requests that you might have. Also, write student numbers of absent students on back. 




ERlCEVAL/ll/25/74/ca/g4^m 



97 



Appalachian Education Satellite Project 

Resource Coordinating Center 
306 Frazee Hall, University of Kentucky 
Lexington, Kentucky 40506 

CLASS RATING- FORM 

' This questionnaire deals with your reactions to today's instructional 
activities. The questionnaire consists af four parts: 

Part I - TV Program (lecture) 
Part II - Four-Channel Audio Segment 
Part III - Seminar 
Part IV - Laboratory Activities 

Only fill out the parts that correspond to today's activities, e.g., if you saw -a 
TV program (lefcture) and did the laboratory activities, you would fill out Parts 
I and IV. 

Please answer as truthfully as possible. Your answers do not affect 
your grade in the course, "but help us to assess the effectiveness of the course 
and suggest improvements. 

Mark your answers on the Op-Scan sheet provided. Turn the Op-Scan sheet 
so that the box that says "STUDENT NUMBER*' is on your lower right. Fill out the 
box labeled "1 2 3 4 5" and the box labeled "STUDENT NUMBER" as indicated in the 
diagram below. 




C 



D 

JL 



BIRTH 
DATE 
MOlYEAR 



STUDENT 
NUMBER 



1 


1 


3 














/ 




0 


0 


0 


0 


0 




\ 


1 


\ 


1 


/ 




? 


7 


2 


1 


3 




3 


3 


4 


1 


4 




4 


5 


5 


5 


5 


f. 




6 


6 




6 


7 




7 


7 




n 






8 


J 






'J 


7 





A copy this just as it appears 

B * fill in the 2 digit class meeting 
number. The site monitor can tell 
you the correct number for today.* 

C leave blank 

D fill in YOUR 4 digit student 
numbea[^ 

E leave blank 



Use a soft-lead (#2) pencil to mark the answer sheet — do not use a pen or 
ball-point. Be sure your mark fills the entire block of the response you wish to 
make. Your mark should be heavy, black and stay within the lines so that the machine 
can read your replies. If you change your mind or maUce a mistake, before that you 
erase completely. Do not make any other marks on the answer sheet. 



Tiira:! the sheet so that the words "STANDARD ANSWER SHEET-C" are on your lower 
left. Begin"^ answering at the appropriate part for today's activities. Be careful 
that the l^eirr" riumber on the questionnaire corresponds to the number on the Op-Scan 
sheet that you are" marking. 
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PART I: TV PROGRAM (Lecture) 

Mark on the Op-Scan answer sheet the responses you selected to items 1 
^through 15 if you watched the first televised lecture today to satisfy course 
requirements. Use the same question set to fill in items 16-30 on the Op-Scan 
sheet .J.f you watched a second televised lecture 'today Jbo satisfy course requirements. 
Wa^ite the title of the program (s) you saw on the Op-Scan sheet in the space labeled 

1. (16) Which presentation mode helped you most to understand the content of 
today's TV lecture? 

thp instructor talking on the screen ^ \^ 
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1) 

2) classroom scenes with the instructor describing activii:ies 

3) the instructor explaining the information contained on charts 

4) scehes of a teacher working wit|i students 

5) interviews of experts or practioners 

(17) Which ^presentation mode was least effective in communicating the ideas 
in today's TV lecture? 

1) the instructor talking on the screen 

2) classroom scenes with the instructor describing activities 

3) the instructor explaining the information contained on charts 
scenes of a teacher working with students 

5) interviews of experts or practioners 

(18) The program might have been more effective if the coverage had been 
all;ered in which one of the following ways? 

less material had been covered but in greater depth 
less material because there was too much to comprehend at one time 
more material relevant td the central issues of the course 
l^e^^'^ogram coverage was adequate 

4. (19) Today's discussion may have been better-if more time had been devoted to 

which one of the following? 

more discussion df the theoretical aspects of today's topic 

2) more discussion of procedures for using the materials 

3) more examples 4)f how the techniques are actually applied in the 
classroom 

4) the discussion was an adequate mix of theoretical, procedural, and 
application levels for today's topic 

5. (20) The discussion of topics in today's program may have been better if less 

time had been devoted to which one of the following? 

1) less discussion of the theoretical aspects of today's topic v. 
vv 2) less discussion of procedures for using the materials 

3) fewer exafhples of how the techniques are actually applied in the 
classroom 

^ -^4) the discussion was an adequate mix of theoretical, procedural, and 
application levels for today's topic 
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6, (21) Which one of the following things might make the moderator more 
acceptable to you? 

1) if he enunciated more carefully 

2) if he understood more what he was talking about 

3) if he talked in a more natural way 

4) he is quite acceptable as he is 

?• (22) Which one of the following improvements might make the lecture easier 
to follow? 

1) more explicit transitions between ideas 

2) more careful organization of the cppjtefit 

3) greater amplification of main points ^ 

4) more sxnnmary statements 

5) the program organization was acceptable the way it was 

8. (23) What effect do you think today's program will have on your teaching? 

1) ^the information had little or no relevance for me in my teaching 

situation / 

2) something I would like to use but probably won't be able to 

3) something I would like to use but don't understand enough to use 

4) something I plan to use 

5) something I already know or am using 

Which of the following suggestions would have improved today's TV program? 

9. (24) More close-ups of individual's faces were needed. 

1) yes 2) no 

10, (25) More close-ups of charts, books, and other written materials were needed^ 
1) yes 2) 

11 • (26) Charts and written materials needed to be held on the screen longer so 
•that they could -be read through. \ 

\ 

t) yes 2) no ^ 

12 • (27) Charts and written materials needed to be on the screen for a shorter 
period. 

1) yes 2) no 

13, (28) Did the pace of the progreun need to move 

, * 1) ; slower 

2) faster 

3) the pace was acceptable 
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14* (29) What is your overall evaluation of today's TV program (lecture)? 

1) excellent 

2) very good 

3 ) good 

4) fair 

5) poor 

15. (30) Do you have a specific comment or suggestion about today's TV program 
to meike? 

1) yes 2) no 

If your answer was yes, write your comment on the reverse of the Op-Scan 
sheet. 
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A PART II: FOUR-CHANNEL AUDIO SEGMENT 

Fill out items 41 to 53 only if there was a four-channel audio segment 
included in today's activities. 



A 1 

41. 


Did 


you 


ever push a button and not hear anything? 




1) 


yes 


2) no 


42. 


Was 


the 


voliame satisfactory? 




1) 


ye^ 


2) no 


43. 


Did 


you 


ever NOT get the channel you selected? 




1) 


yes 


2) no 


44. 


Did 


you 


ever hear two or more channels at the same time? 




1) 


yes 


2) no 


45. 


Did you ever hear any static or odd noises? (you might hear 
these are supposed to be there) 




1) 


yes 


2) no 


46. 


The time interval in which to select a response was 
(choose one) 




1) 
2) 


too 
too 


long 
short 



\ 



3) about right 

47. Which one of the following changes might make the greatest improvement in the 
relevancy of today *s audio review to today's topic? 

1) if the content dealt more thoroughly with the concepts covered in the 
TV program 

2) if the content focused more on ways to apply the techniques described in 
the TV program 

3) if the content expanded upon concepts relevant to those introduced in the 
TV program 

4) it is quite good as it is 

48. Which one of the following would have resulted in a better four-channel audio 
segment? 

1) there were more but shorter items 

2) there were more items of the same length as they are now 

3) there were more items of greater length than they are now 

4) there are enough items now of about the right length 

5) the problem is not with the number of items but with the use of the audio 
segment as an instructional medium 

m. 102 i 
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49. Do you feel that the questions might be most improved if 

1) , 'they were shorter 

2) the problem was more clearly stated 

3) both 1 and 2 

4) the length amd clarity of the questions were satisfactory 

50. Do you feel the alternatives might be most improved if they were 

1) shorter 

2) longer 

3) fewer . 

4) they were O.K. as they were 

51. Do you feel the explanations of the answers might be most improved if they 
were 

1) more thorough but almost the same length 

2) briefer and more to the point 

3) longer with more thorough coverage 

4) the length and coverage was adequate 

52. What is your overall evaluation of today's four-chcinnel audio segment? 

1) excellent* ^ 

2) very good 

3) good 

4) fair / 

5) poor ^ ; ' , 

53. Do you have a specific comment or suggestion about the four-channel you want 
to make? ^ 

1) yes 2) no y 

/ 

If your answer was yes, write your comment ory the reverse of the Op-Scan sheet* 
answer sheet. 



ERIC 



/ 



94 



PART III: SEMINAR 

Answer items 81 to 90 only if a seminar was presented as part of today's 
activities. 

81. Which one of the following fomat changes would you select to mcike the seminar 
format more effective? 

1) a one-hour televised seminar with a 15 minute intermission so that^ questions 
can be generated and transmitted 
I 2) a two-hour seminar with several 15 minute intermissions for question 
generation and transmission 

3) one-hour televised seminar with the opportunity for question generation 
during tile program and 15 minutes prior to the program 

4) one^hour television seminar with direct voice line hook-up between 
"^^^ individual sites ana tv studio ^* ' * 

5) one-hour conference call between one or more content experts and all sites 

82, Which one of the foZ lowing would have made today's seminar more effective? 

1) the course instructor answering the questions himself without guests 

2) use more teachers as guests 

3) use more professors or other experts as guests 

4) the seminar participants were fine 

83/ Which one of the following seminar formats might help you think of more 



meaningful questions to ask? 



1) have at the beginning of the seminar a 10 minute summary of course 
>* s-i. content covered since the last seminar 

2) show a 10 minute film with short segments from previous programs at the 
beginning of the seminar 

3) show at the beginning of the seminar a short film illustrating several 
new classroom demonstrations of material covered 

4) have the opportunity to use the whole seminar for question answering 
and discussion rather than spending part of the progrcim for question 
stimulation 

84. The answers to the questions could have been more valuable had they been handled 
in which one of the following ways? 

1) less discussion of theoretical aspects of the question 

2) ^mo^e frequent use of specific classroom examples ^ 

3) more direct answers to the questions 

4) I was very satisfied with the answers I heard 

r 

/ 
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85. The seminar moderator could have been more ^fective had he been more alert 
to which one of the following? 

1) kept the guests on 'the topic better 

2) provided suiranary statements occasionally 

3) allowed each. guest equal time to respond to questions 
, 4) kept th6 seminar^ moving at a faster pace so more questions could be 
\ answered 

86. Which ope of the following factors would have made the seminar guests' 
pre^^^ations more useful? 

1) not repeating themselves 

2) keeping on the topic of the question 

3) allowing them to express themselves better 

4) relating their answ^s to practical situations 

5) the guests* presentations were excellent 

87. If there was not time to answer your questions on the seminar do you feel that 
the answer you will receive via teletype or VHP will be useful? 

1) yes 2) no ^ ^ 

88. Do you feel that answering questions via teletype or VHF is a se*rvice that needs 
to be continued? 

1) yes 2) no ^ 

89. What is your overall evaluation of today's seminar? 



1) excellent 

2) very good 

3) good 

4) fair 
5k)^ poor* . 

90. Do you have a^Specific cornment or suggestion about the seminar you want to make? 
1) y'fes 2) no 

If your answer was yes, write your comment on the reverse of the Op-Scan sheet. 
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PART IV: LABORATORY ACTIVITIES. 
Answer items 121 through 134 only if there were laboratory activites (lab) 

today. ' 

121. Did you use materials from the reference shelf during today's meeting? 

1) I needed to, but there was not enough time ^ 

2) there was no need to use the materials today 

3) I used the materials, a little 

4) I used the materials quite a bit 

122. How much time did you spend working on the Icib today? , 

1) 30 minutes or less 

2) 45 minutes 

3) 60 minutes 

4) 90 minutes 

5) ^ two hours or more 

How would you have improved today's Iciboratory activities? 

123. For today's lab I would try to cover 

1) more material ^ 

2) less material 

3) the lab was O.K. in this area 

124. Clearer instruct iona are needed for the lab activities. 
1) yes 2) the lab was O.K. in this area ^ 

125. Select lab activities more related to today's topic. 
1) yes 2) the lab was O.K. in this area 

12^. Allow more time for the lab activities to be completed. 

1) yes 2) the lab was O.K. in this area ^ 

127. Provide activities that were of a more applied and practical nature^ 
1) yes 2) the lab was O.K. in this area 

128. Require less material to be read prior to class as preparation. 
1) yes 2) the reading assigi^ents were O.K. 



/ 
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129, Require more relevant, preparatory readings for .today's activities, 
1) yes 2) the reading assignments were 0,K, 

130, Stock materials that are more relevant'' on the reference shelf, 
1) yes ^ 2) the reference shelf was adequate for tdday's assignment 

131, Would have assigned more useful homework last 'week, 
1) yes 2) no, the homework was very useful 

132, What is your overall evaluation of today's laboratory activities? ^/ 

^ / 

1) excellent 

2) very good 

3) good 

4) fair^ 

5) poor * 

133, Did you feel there were any activities that were especially innovative 
creative in today's lab?. 

1) yes 2) no 

If so, please idAitify those activities on the back of the Op-Scan sheet, 

134, Do you have a specific comment or suggestion about the lab ^^u^^^jant^o make? 

1) Y^^sr 2T no • * ' ^ j ^ / 

If your answer was yes, ^rite your comment on the reverse, of the C)p<*9can 
sheet, ' ' ^^-^ ■ / 




/ 
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DPRI JfclFORMATION SYSTEMS QUESTIONNAIRE 



Instructfons 



f 



I 
I 



This questionnaire has two parts. Part I is concerned with your/ 
/ 'attitudes toward the infonnayioh systems presented in class. Part II is . 
concerned with the degree to/ which ypu used thejja^ollnalion systems' to ^ 
assist you in developing covirs^j^iatfia^^ clasa'es you teach. 

Please answer as truthfully as possible. Your answers/ do not affect your 
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grade in the course, but help us to assess the effectiveness of these 
systems and suggest improvements < 



Write your replies on the Op-Scan shfeet provided, * Turn the Op-Scan 
sheet so that the box that says "STUDENT NIJMBER" is On your lower right* 
Fill out the box labeled "1 2 3 4 5" and tfie box labeled "STUDENT NUMBER" 



as' indicated in * '"e diagram below. 




A copy this just as it^ appears "66518 



B leave blank 



C fill in YOUR' 4 ^digit 
student number 

D leaVe blank 



§oft-lead (#2) p^cil to mark the answer slieet — do not use 
a pen or laraii-point • Be su^ your mark fills the 'entir^ block of the 
response^you wis^ to mak^ Your mark should be heavy/ black and stay 
withirv the lines so th^ the Op-Scan machine can rea0 your refplies. If 
you chan^p your mind^or make a mistake, be sure»tha^ y^u erase completely. 
Do not make any otb^r marks on the answer sheet. 



f ■ 



Turn th6 sheet so that the words "STAl 
your /lower .left. Begin answering at number 1 
the items placing a heavy vertical line iA the 
appif-opriajz^ item number on the answer sheet. Be 
nuijiDer ^ the questionnaire portesponds to the 
tljat you are marking. 



SWER SHEET-C" are oK 
Indicate your answers to 
olumn beside the 
areful that the item * 
er on the Op-Scan sheet 




PART 



For Part I Mark: 



5) if you strongly agree with the s^tement 

4) if you moderately agree 

) if you €eel neutra** 

2) . if you moderately disa^r^e 

1) if you strongly disagree 

If you did no1$;^se the informatLon system referred to in the statement, do 
not rate the statement (leave that item on the Op-Scan feheet blank) . 



1. The Select-Ed manual adequately explained how to use aria interpret this 
information system. 



\ 



2. 
3. 

s'. 



The search request fonn for the Select-Ed systeijf was ^clear in its format. 

The Select-Ed searc)/(es) I ran provided me with useful informaCLon. 

*.The information >a^ceived from the Select-Ed system was easy t© interpret. 

If the Se^jBtit-Ed system were available to me, in my school system, 
I woujd^se it to aid me in my teaching. 



The Kentucky System manual adequately explained how to use and interpret 
this information system* 



brmat. 



The search request form for the Kentucky System was clear in 

^entucky System search (es) I ran provided me with useful 
information. 



The information received from the Kentucky System was easy to ,interpret. 

If the Kentucky sysb^ were available to me, in my school system, I 
would use it to aid me^in my teaching. 




♦Kentucky System is an abbreviation for "Kentucky Special Eduction Mate; 
. Information System." 
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PART II 
Section A 



11, How many times during this semester did you request searches u^ing the 
Se3.ect-Ed system? 

1. I only did the class assignment 

2. One time, other than the class assignment 

3. Two times 

4. Three times 

5. Four, or more times 

12. How many times during this semester did you request searches using the 
Kentucky System? 

« 

1. Never 

2. One time 

3. Two times ^| 

4. Three times ^ 

5. Four, or more times 



Section B 




If you did request a search using the Select-Ed system^ in addition to the 
one search that was a class assignment, please skip to Section C. Otherwise 
answer yes or no to Questions 13-15 below concerning your reasons for not 
requesting additional Select-Ed searches. 



13, I did not have the time to carefully study the manual so I could run a 
search. 

1. Yes. 

2. No ' # 

14. The directions and procedures to request a search were confusing and 
made it difficult to use the system, 

1. Yes 

2. No 

15^ I did not use the Select-Ed system because it just gives you references 
that^J^ou have to look up in the library* 

1. Yes 

2. No 
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Section C 



If you did request any Kentucky System searches, skip to Section J). If you did 
not request a search using the Kentucky. System answer yes or no to items 
16-18, below, ^^^ .^ 

<. 

16, I did not have the time to carefully study the manual so I could run a 
search, ^ ^ 

1. Yes ^ 

2. No 

17, The directions and prpcedures to request a search were confusing and made 
it difficult to uJ^e the system, , ^ 

1. Yes 

2. No 

18, I did not use the Kentucky System because it iust gives you references 
that you have to look up in the library. 

1. Yes 

. 'fi. No < ^ ^ 

Section D 



Answer yes to the following suggested improvei!tents in the information system 
procedures if you think such' improvements would be of benefit. Answer no if 
you do not feel that the suggestion would be of substantial benefit 



19, Provide manuals that are easier to understand, 

1. Yes 

2, No < 

20, Provide simpler forms to use to request searches. 



1. Yes 

2. No 



21, Give the site monitor training in the information system so that he/she 
is a more effect d^ve instructor, ^ 

1, Yes 

2. No 

22, Develop a video pi^ogram that would explain the use of the information 
systems in a#nore adequate manner than the present video program 
(program 7 - Prescriptive Instructional Systems), 
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Would you have utilized the inf<pnnation systems more if the materials recommended 
in the searches were readily available ^ 

23. At the AESP classroom site? 

1. Yes ' ' 

2. No 

24. At your school? ^ 

1. Yes 

2. No * 

25. At some central location (e.g., school district headquari:ers, 
local colleger etc.)? 

1. Yes 

2. No , 

Did you know that you could run searches on your own (over and aboy^e the class 
assignment? * ^ 

26. For Select-Ed 




.1. Yes 
2. No 



7. For the Kentucky System 



1. Yes 

2. No 



28. Did your site coordinator encourage you to run infonnatid|n searches on 
your own? 

1. Yes 

2. No 

Did you incorporate materials suggested^by your searches in your lessons? 

29. Seledt-ld suggested materials 

1. Yes 

2. No 

30. Kentucky system sug^gested Inaterials 



1. Yes 

2. No 
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31. Did you look up materials suggested in the searches? 

1. Yes ; 

2. No 

32. If your answer to item 31 is no, why did you not look up materials 
suggested by the searches? Otlierwise, leave this item blank. 

1. I did jiot have time ^ ' 

2. Materials suggested could not be found within a reasonable distance 

3. I did not know where to go to find the materials 

4. It was too much trouble 

5. Other reason 




Appalachian Education Satellite Project 

Resource Coordinating Center 
306 Prazee Hall, University of Kentucky 
Lexington, Kentucky 40506 



READING 
SUMMATIVE COMMENTS FORM 



Student Number Site 



In o«^er to evaluate the overall effectiveness of ^e course and to provide 
inf omikt for futixre course revision, please summarize your general impressions 
of the couiT5«, Try to be as spec^ic as possible in stating what you liked about 
the course, what you disliked, anAwhy. Write your comments on this form. There 
is no Op-Scan sheet. 

/ 

1) Were there any specific programs that you liked or did not like? Why? 



« 

2) What suggestions for course improvement do you have? Please be as 
specific as possible. 



\ 

\ 



3) would you recommend this course to your peers? Why or why not? 



4) Include any other information which you feel would be useful in evaluating 
the overall effectiveness of the course. Please try to be as specific as 
possible. 
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Rate the following ten instructional activities according to the quantity 
of useful information you received from each. Make your standard of reference 
an average, graduate education course. Pate the value of the activity by 
marking the point on the scale that best expresses your attitude. The closer 
to 1 the more outstanding you found the activity, while the closer to 8 the 
more unacceptable you found the activity, 

1, Pre-Program Preparation compared to work usually assigned in other graduate 
classes prior to covering material in class. 



outstanding 



unacceptable 



Comments : 



2, TV Program compared to a graduate lecture 
outstanding — - 

__J L 



Comments : 



e . 7 



unacceptable 




3, Four-Channel Audio corrpar^ to class quizzes followed by a discussion^ 
of the answers, * 



outstanding 

1 -t: 



unacceptable 



Comments: 



4, Laboratory Activities compared to laboratory activities associated 
with other graduate courses, 

outstanding . unacceptable 

111 1 I I I - 1 ^1 

1-2 3 4 5 6 7 8 

Comments: 
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/ 

5« On-site Reference Materials compared to materials placed on reserve by 
other graduate instructors. 

outstanding unacceptable 

I \ I \ I \ \ I 1 

12345678 

Comments : 



^» Televised, Interactive Seminars compared to other graduate seminars and 
class discussions. 

.1 2 3 4 5 6. ^^7 8 

Comments: 



7. The Seminar Host and Guests as knowledgeable, fluent discussants of the 
seminar topics* 

outstanding unacceptable 

I \ \ \ I I I I I 

12345678 
Comments : 



8* Information Retrieval Systems Materials compared to materials instructors 
in otjier graduate courses locate to help specific individuals. 

outstand/ng unacceptable 

1-^ I \ I I I I I I 

/I 2 3,4 5 6 7 8 

Commei^ts : 

/ 

/ 



/ ' 
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Follow-up Activities and homework assignments compared to similar . 
.activities in other graduate courses. . 



outstanding 



J L 



Coroments : 



10. The Site Coordinator as an effective course leader, 
outstanding 



2 



unacceptable 



8 



unacceptable 



Conments : 
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TABLE A: PARTICIPANT RESPONSES TO TELEVISION PROGRAMS FROM CLASS 
RATING FORM, 

TABLE B: PARTICIPANT RESPONSES TO FOUR-CHANNEL AUDIO SEGMENTS FROM 
CLASS RATING FORM 

TABLE C: PARTICIPANT RESPONSES TO SEMINARS FROM CLASS RATING FORM 

TABLE D: PARTICIPANT RESPONSES TO LABORATORY ACTIVITIES FROM 



CLASS RATING FORM 




7 
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